-- Logs begin at Mon 2022-06-20 05:13:49 UTC, end at Mon 2022-06-20 07:01:58 UTC. -- Jun 20 06:02:17.819380 dv-cinder-804735-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 06:02:17.828072 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 06:02:17 2022] *** Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: nodename: dv-cinder-804735-31-iscsi Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: machine: x86_64 Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: clock source: unix Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: pcre jit disabled Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: detected number of CPU cores: 4 Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: current working directory: / Jun 20 06:02:17.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: detected binary path: /usr/bin/uwsgi-core Jun 20 06:02:17.830988 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: your processes number limit is 47680 Jun 20 06:02:17.830988 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: your memory page size is 4096 bytes Jun 20 06:02:17.830988 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: detected max file descriptor number: 2048 Jun 20 06:02:17.830988 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: lock engine: pthread robust mutexes Jun 20 06:02:17.830988 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: thunder lock: enabled Jun 20 06:02:17.830988 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 06:02:17.830988 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 06:02:17.873420 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: Python main interpreter initialized at 0x5652063779c0 Jun 20 06:02:17.873420 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: python threads support enabled Jun 20 06:02:17.873420 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: your server socket listen backlog is limited to 100 connections Jun 20 06:02:17.873420 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: your mercy for graceful operations on workers is 90 seconds Jun 20 06:02:17.873772 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 06:02:17.873848 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: *** Operational MODE: preforking *** Jun 20 06:02:17.874061 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: *** uWSGI is running in multiple interpreter mode *** Jun 20 06:02:17.874061 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: spawned uWSGI master process (pid: 103347) Jun 20 06:02:17.874249 dv-cinder-804735-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 06:02:17.874768 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: spawned uWSGI worker 1 (pid: 103348, cores: 1) Jun 20 06:02:17.875102 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: spawned uWSGI worker 2 (pid: 103349, cores: 1) Jun 20 06:02:17.877928 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 06:02:18.538238 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:02:18.546757 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:02:19.676242 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:19.676242 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: from cryptography.utils import int_from_bytes Jun 20 06:02:19.676850 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:19.676850 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: from cryptography.utils import int_from_bytes Jun 20 06:02:19.678166 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:19.678166 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Jun 20 06:02:19.678611 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:19.678611 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Jun 20 06:02:22.141816 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:02:22.142367 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:02:22.142574 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:02:22.142928 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:02:22.143280 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:02:22.143280 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:02:22.143449 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:02:22.143558 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.143695 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:02:22.143885 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.144054 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:02:22.144209 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.144296 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:02:22.144529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.144680 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.144862 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.145005 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.145174 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.145326 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.145517 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.145670 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.145839 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.146002 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.146169 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.146313 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.146430 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.146631 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.146755 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.146955 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.147101 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-31-iscsi {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.147281 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.147372 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.147542 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.147646 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.148110 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.148204 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.148433 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-31-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.148520 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.148754 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.148848 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.149058 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.149154 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.149366 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.149474 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.149699 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.149903 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.150013 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151018 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151115 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151183 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151259 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151259 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151377 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151459 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151526 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151599 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151671 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151861 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.151982 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.152162 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.152317 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.152476 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.152637 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.152796 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.152937 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.153105 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.153252 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.153524 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-31-iscsi {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.153622 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.153843 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.153956 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.154153 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.154254 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.154463 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.154557 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-31-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.154860 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.154946 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.155169 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.155264 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.155474 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.155569 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.155796 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.155883 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.156129 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.156264 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.157018 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.157280 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.157400 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.157483 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.157672 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.157779 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.157980 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.158074 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.158300 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.158386 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.158605 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.158692 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.158914 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.158999 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.159225 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.159312 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.159525 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.159618 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.159833 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.159921 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.160135 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.160219 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.160387 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.160475 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.160693 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.160778 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.161014 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.161110 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.161264 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.161349 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.161595 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.161694 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.161913 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.162012 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.162166 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.162255 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.162488 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.162588 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.162778 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.162873 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.163028 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.163116 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.163345 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.163438 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.163663 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.163758 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.163969 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.164055 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.164271 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.164364 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.164573 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.164677 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.164875 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.164961 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.165176 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.165354 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.165506 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.165608 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.165798 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.165886 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.166102 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.166198 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.166410 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.166495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.166717 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.166803 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.167038 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.167132 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.167343 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.167435 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.167647 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.167740 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.167984 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.168080 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.168275 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.168360 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.168581 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.168668 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.168904 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.169033 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.169220 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.169312 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.169551 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.169660 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.169855 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.169941 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.170162 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.170254 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.170466 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.170550 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.170769 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.170857 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.171073 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.171172 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.171329 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.171414 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.171627 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.171714 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.171982 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.172128 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.172302 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.172500 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.172635 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.172803 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.172889 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.173193 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.173284 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.173518 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.173620 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.173824 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.173911 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.174127 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.174212 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.174431 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.174517 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.174728 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.174812 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.175028 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.175113 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.175328 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.175421 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.175630 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.175715 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.175930 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.176023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.176229 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.176315 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.176526 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.176610 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.176829 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.176925 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.177131 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.177217 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.177456 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.177569 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.177763 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.177868 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.178068 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.178162 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179328 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179426 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179652 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179718 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179802 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179869 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.179935 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180007 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180073 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180149 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180217 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180283 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180433 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180583 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180733 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.180819 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.181029 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.181113 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.181344 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.181460 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.181670 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.181805 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.181987 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.182072 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.182292 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.182388 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.182591 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.182713 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.182890 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.182974 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.183194 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.183296 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.183494 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.183579 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.183792 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.183876 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.184087 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.184180 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.184385 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.184490 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.184683 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.184774 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.184983 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.185070 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.185281 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.185404 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.185604 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.185691 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.185900 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.185988 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.186200 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.186286 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.186515 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.186608 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.186820 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.186914 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.187125 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.187211 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.187427 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.187570 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.187925 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.188011 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:22.188295 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.188381 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.188630 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.188730 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.188973 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.189059 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.189286 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.189370 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.189630 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.189735 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.189960 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.190046 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.190270 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.190356 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.190580 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.190667 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.190889 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.190975 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.191214 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.191306 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.191527 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.191615 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.191837 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.191931 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.192148 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.192259 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.192459 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.192546 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.192776 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.192862 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.193086 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.193174 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.193437 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.193528 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.193734 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.193820 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.194049 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.194213 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.194358 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.194447 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.194676 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.194763 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.195005 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.195091 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.195318 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.195405 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.195628 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.195712 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.195950 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.196044 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.196263 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.196358 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.196574 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.196662 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.196884 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.196979 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.197200 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.197285 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.197532 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.197633 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.197844 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.197940 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.198153 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.198240 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.198460 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.198545 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.198772 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.198873 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.199081 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.199168 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.199392 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.199478 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.199698 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.199792 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.200008 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.200096 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.200313 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.200402 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.200623 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.200710 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.200931 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.201016 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.201252 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.201340 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.201587 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.201675 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.201893 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.201985 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.202199 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.202284 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.202502 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.202588 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.202809 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.202943 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.203627 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.203719 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.203939 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.204027 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.204248 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.204375 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.204553 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.204699 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.204858 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.205028 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.205165 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.205339 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.205492 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.205764 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.205853 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.206074 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.206161 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.206384 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.206470 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.206694 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.206789 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.207003 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.207096 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.207310 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.207396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.207615 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.207742 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.207921 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.208006 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.208223 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.208321 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.208531 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.208619 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.208835 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.208936 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.209138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.209239 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.209480 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.209586 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.209786 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.209873 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.210088 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.210182 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.210400 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.210488 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.210701 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.210833 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.211005 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.211101 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.211317 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.211405 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.211621 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.211706 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.211926 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.212019 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.212237 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.212323 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.212543 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.212630 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.212867 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.212955 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.213178 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.213272 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.213508 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.213596 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.213839 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.213929 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.214164 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.214249 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.214469 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.214566 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.214770 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.214863 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.215080 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.215166 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.215385 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.215560 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.215687 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.215775 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.215992 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.216078 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.216295 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.216399 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.216596 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.216689 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.216896 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.216989 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.217195 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.217293 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.217517 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.217619 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.217818 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.217903 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.218114 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.218213 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.218418 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.218506 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.218741 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.218843 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.219593 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.219836 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.219922 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.220149 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.220238 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.220485 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.220579 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.220789 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.220876 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.221130 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.221215 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.221454 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.221575 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.221797 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.221884 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.222119 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.222205 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.222435 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.222531 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.222752 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.222839 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.223062 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.223147 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.223371 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.223458 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.223676 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.223760 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.223983 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.224069 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.224291 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.224378 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.224597 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.224689 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.224912 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.225004 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.225219 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.225305 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.225566 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.225652 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.225873 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.225958 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.226191 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.226277 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.226494 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.226578 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.226806 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.226903 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.227108 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.227199 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.227420 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.227508 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.227758 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.227895 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.228076 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.228168 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.228386 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.228472 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.228699 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.228798 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.229005 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.229090 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.229310 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.229430 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.229642 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.229738 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.229950 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.230035 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.230254 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.230339 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.230564 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.230660 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.230878 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.230964 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.231180 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.231265 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.231491 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.231584 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.231797 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.231884 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.232111 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.232195 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.232415 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.232510 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.232726 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.232813 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.233029 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.233114 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.233340 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.233468 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.233690 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.233776 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.234003 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.234097 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.234335 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.234486 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.234646 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.234736 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.234960 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.235060 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.235269 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.235354 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.235571 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.235656 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.235877 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.235977 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.236179 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.236271 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.236481 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.236576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.236787 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.236882 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.237098 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.237186 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.237422 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.237512 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.237736 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.237834 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.238043 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.238129 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.238346 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.238432 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.238649 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.238737 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.238947 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.239045 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.239250 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.239337 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.239560 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.239649 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.239876 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.239959 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.240182 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.240267 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.240488 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.240583 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.240794 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.240879 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.241095 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.241219 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.241423 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.241537 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.241731 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.241829 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.242035 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.242132 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.242334 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.242418 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.242647 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.242745 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.242950 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.243056 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.243257 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.243345 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.243575 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.243668 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.243874 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.243974 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.244187 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.244286 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.244496 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.244598 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.244802 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.244971 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.245109 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.245211 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.245432 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.245522 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.245743 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.245833 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.246047 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.246132 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.246363 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.246457 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.246671 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.246760 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.246980 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.247068 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.247287 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.247372 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.247591 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.247678 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.247901 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.247988 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.248207 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.248292 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.248515 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.248602 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.248818 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.248914 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.249124 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.249219 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.249447 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.249535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.249758 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.250060 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.250175 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.250386 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.250641 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.250737 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.250972 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.251067 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.251287 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.251383 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.251603 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.251692 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.251923 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.252010 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.252241 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.252338 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.252575 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.252674 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.252880 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.252975 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.253187 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.253274 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.253531 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.253649 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.253812 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.253899 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.254123 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.254216 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.254425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.254519 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.254725 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.254818 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.255027 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.255113 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.255329 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.255423 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.255630 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.255715 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.255928 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.256013 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.256228 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.256322 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.256529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.256615 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.256826 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.256921 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.257128 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.257215 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.257462 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.257565 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.257766 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.257859 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.258076 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.258212 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.258379 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.258466 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.258679 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.258772 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.258982 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.259070 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.259279 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.259364 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.259580 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.259674 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.259880 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.259976 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.260218 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.260304 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.260520 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.260617 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.260854 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.260941 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.261157 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.261243 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.261490 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.261596 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.261814 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.261901 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.262116 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.262202 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.262416 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.262510 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.262718 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.262806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.263020 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.263112 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.263324 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.263410 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.263631 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.263741 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.263935 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.264042 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.264236 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.264326 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.264543 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.264629 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.264847 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.264939 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.265149 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.265243 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.265479 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.265570 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.266306 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.266392 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.266694 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.267007 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.267322 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.267630 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.267935 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.268239 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.268546 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.268852 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.269155 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.269483 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.269787 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.270102 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.270403 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.270633 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.270823 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.270994 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.271304 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.271609 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.272072 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.272420 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.272973 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.273292 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.273625 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.274014 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.274328 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.274475 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.274633 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.274826 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.274928 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.275165 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.275251 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.275506 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.275593 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.275839 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.275934 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.276144 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.276230 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.276447 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.276548 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.276753 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.276854 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.277057 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.277145 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.277364 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.277473 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.277690 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.277790 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.277994 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.278083 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.278297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.278423 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.278603 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.278693 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.278909 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.278996 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.279232 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.279318 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.279542 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.279631 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.279844 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.279933 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.280147 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.280233 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.280448 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.280536 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.280783 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.280875 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.281083 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.281174 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.281673 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.281766 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.282109 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.282289 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.282441 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.282753 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.282841 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.283072 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.283377 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.283464 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.283686 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.283921 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.284020 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.284297 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.284463 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.284609 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.284917 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.285012 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.285225 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.285560 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.285652 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.285873 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.286111 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.286216 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.286502 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.286656 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.286811 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.287117 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.287216 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.287424 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.287722 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.287816 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.288063 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.288261 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.288429 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.288739 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.288827 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.289056 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.289355 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.289508 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.289700 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.289927 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.290014 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.290317 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.290489 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.290626 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.290943 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.291054 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.291255 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.291569 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.291654 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.291875 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.292139 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.292227 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.292489 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.292679 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.292802 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.293116 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.293224 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.293466 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.293788 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.293875 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.294110 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.294333 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.294421 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.294716 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.294870 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.295029 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.295338 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.295432 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.295650 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.295939 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.296025 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.296254 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.296484 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.296580 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.297426 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.297587 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.297879 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.298005 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.298297 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.298397 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.298609 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.298685 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.298921 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.299008 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.299232 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.299319 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.299540 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.299632 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.299864 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.299957 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.300175 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.300262 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.300484 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.300569 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.300792 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.300878 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.301099 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.301186 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.301439 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.301565 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.301749 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.301925 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.302180 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.302268 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.302495 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.302581 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.302809 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.302904 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.303115 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.303201 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.303426 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.303514 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.303739 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.303832 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.304052 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.304145 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.304356 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.304441 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.304660 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.304775 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.305077 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.305164 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.305397 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.305484 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.305715 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.305804 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.306021 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.306110 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.306324 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.306410 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.306632 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.306722 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.306943 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.307030 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.307247 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.307346 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.307552 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.307641 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.307856 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.307941 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.308166 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.308253 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.308466 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.308552 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.308781 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.308856 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.309105 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.311765 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.311765 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.312002 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.312110 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.312216 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.312216 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.312428 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.312428 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.313218 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.313324 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.313452 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.313565 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.313686 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.313793 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.313898 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314001 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314105 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314322 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314456 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314577 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314667 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314747 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314825 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.314910 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315002 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315086 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315154 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315219 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315292 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315373 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315463 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315551 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315632 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315710 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315788 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315865 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.315953 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.316039 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.316118 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.316196 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.316499 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.316586 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.316839 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.316927 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.317151 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.317239 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.317496 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.317605 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.317826 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.317924 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.318136 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.318224 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.318440 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.318541 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.318753 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.318842 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.319058 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.319145 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.319363 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.319459 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.319669 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.319756 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.319975 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.320060 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.320284 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.320379 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.320592 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.320677 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.320899 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.320984 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.321199 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.321294 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.321523 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.321613 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.321826 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.321914 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.322140 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.322233 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.322440 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.322527 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.322760 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.322845 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.323070 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.323157 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.323388 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.323473 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.323693 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.323780 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.323997 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.324085 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.324307 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.324404 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.324615 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.324730 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.324916 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.325049 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.325218 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.325526 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.325634 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.325840 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.325934 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.326177 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.326270 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.326481 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.326583 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.326802 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.326909 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.327115 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.327236 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.327453 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.327709 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.327813 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.328038 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.328132 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.328536 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.328629 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.328880 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.328990 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.329631 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.329718 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.329789 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.329865 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.329933 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.329999 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.330097 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.330216 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.330408 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.330505 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.330713 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.330817 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.331016 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.331111 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.331319 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.331416 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.331621 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.331707 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.331924 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.332009 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.332228 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.332324 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.332532 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.332619 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.332835 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.332923 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.333146 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.333234 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.333474 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.333565 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.333779 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.333867 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.334080 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.334169 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.334379 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.334465 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.334679 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.334773 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.335003 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.335098 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.335311 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.335398 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.335642 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.335728 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.335957 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.336052 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.336279 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.336368 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.336585 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.336685 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.336902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.336995 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.337213 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.337312 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.337556 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.337660 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.337875 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.337961 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.338184 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.338277 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.338499 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.338596 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.338817 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.338905 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.339132 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.339223 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.339440 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.339537 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.339770 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.339853 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.340048 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.340136 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.340358 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.340446 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.340670 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.340902 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.341212 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.341318 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.341566 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.341656 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.341881 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.341977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.342196 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.342289 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.342509 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.342596 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.342826 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.342932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.343138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.343233 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.343448 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.343550 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.343783 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.343880 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.344095 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.344199 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.344408 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.344500 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.344734 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.344826 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.345056 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.345157 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.345405 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.345510 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.345720 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.345813 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.346037 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.346130 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.346349 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.346442 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.346660 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.346752 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.346972 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.347068 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.347315 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.347405 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.347621 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.347725 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.347930 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.348017 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.348243 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.348329 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.348558 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.348664 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.348871 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.348959 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.349181 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.349275 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.349516 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.349620 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.349830 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.349928 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.350139 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.350228 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.350450 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.350541 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.350760 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.350845 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.351073 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.351160 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.351389 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.351479 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.351714 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.351803 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.352030 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.352116 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.352347 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.352436 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.352659 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.352746 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.352971 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.353067 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.353291 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.353506 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.353819 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.353906 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.354136 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.354236 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.354463 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.354550 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.354788 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.354881 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.355101 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.355201 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.355419 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.355507 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.355733 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.355827 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.356037 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.356132 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.356340 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.356430 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.356647 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.356734 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.356961 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.357058 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.357263 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.357349 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.357596 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.357685 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.357902 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.357989 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.358205 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.358292 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.358509 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.358596 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.358814 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.358901 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.359125 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.359871 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.360193 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.360295 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.360541 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.360635 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.360856 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.360948 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.361183 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.361306 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.361527 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.361647 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.361839 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.361928 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.362144 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.362240 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.362466 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.362553 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.362773 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.362859 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.363080 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.363178 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.363386 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.363472 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.363690 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.363780 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.363993 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.364088 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.364300 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.364386 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.364607 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.364706 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.364913 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.365014 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.365215 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.365302 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.365539 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.365628 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.365858 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.365955 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.366164 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.366250 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.366470 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.366559 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.366775 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.366862 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.367080 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.367175 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.367380 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.367474 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.367683 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.367779 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.367986 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.368073 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.368286 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.368386 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.368588 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.368685 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.368889 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.368975 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.369191 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.369286 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.369519 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.369610 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.369825 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.369911 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.370129 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.370238 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.370429 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.370517 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.370738 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.370835 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.371084 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.371183 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.371394 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.371496 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.371694 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.371786 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.371999 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.372092 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.372307 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.372399 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.372612 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.372710 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.372927 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.373025 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.373233 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.373320 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.373568 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.373659 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.373913 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.374009 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.374229 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.374434 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.374753 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.374840 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.375687 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.375811 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.376008 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.376112 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.376342 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.376441 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.376674 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.376763 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.376983 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.377072 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.377293 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.377559 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.377648 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.377763 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.377940 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.378092 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.378252 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.378407 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.378564 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.378718 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.378876 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.379032 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.379184 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.379494 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.379656 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.379805 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.379965 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.380133 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.380274 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.380424 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.380569 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.380732 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.380880 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.381039 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.381191 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.381347 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.381529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.381683 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.381839 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.381997 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.382148 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.382343 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.382462 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.382661 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.382802 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.382977 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.383120 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.383290 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.383438 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.383603 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.383755 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.383915 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.384071 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.384225 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.384383 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.384537 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.384680 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.384845 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.384988 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.385159 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.385297 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.385508 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.385638 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.385822 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.385968 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.386126 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.386282 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.386542 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.386632 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.386856 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.386988 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.387173 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.387300 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.387493 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.387624 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.387802 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.387944 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.388122 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.388254 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.388446 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.388577 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.388756 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.388901 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.389075 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.389213 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.389401 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.389558 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.389731 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.389870 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.390064 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.390199 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.390394 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.390535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.390761 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.390930 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.391111 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.391259 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.391462 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.391584 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.391769 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.391904 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.392078 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.392171 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.392401 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.392489 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.392708 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.392796 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.393011 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.393112 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.393314 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.393422 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.393662 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.393749 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.393963 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.394051 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.394265 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.394351 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.394567 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.394662 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.394868 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.394954 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.395172 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.395259 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.395473 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.395568 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.395773 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.395859 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.396075 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.396160 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.396378 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.396474 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.396680 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.396766 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.396981 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.397066 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.397290 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.397412 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.397614 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.397701 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.398168 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.398256 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.398469 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.398556 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.398770 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.398856 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.399070 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.399156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.399372 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.399468 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.399704 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.399792 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.400023 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.400115 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.400339 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.400465 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.400648 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.400738 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.400959 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.401055 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.401264 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.401350 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.401607 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.401694 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.401931 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.402031 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.402247 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.402333 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.402557 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.402644 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.402863 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.402961 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.403180 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.403266 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.403489 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.403583 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.403799 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.403893 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.404104 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.404189 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.404412 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.404499 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.404719 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.404807 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.405031 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.405117 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.405353 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.405502 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.405684 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.405776 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.406011 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.406099 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.406371 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.406568 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.406734 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.406950 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.407044 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.407252 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.407340 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.407572 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.407670 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.407893 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.408213 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.408315 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.408530 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.408634 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.408843 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.408936 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.409153 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.409245 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.409487 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.409593 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.409801 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.409938 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.410119 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.410392 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.410492 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.410714 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.410801 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.411048 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.411146 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.411372 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.411471 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.411683 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.411769 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.412015 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.412116 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.412336 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.412431 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.412679 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.412768 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.412992 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.413079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.413314 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.413473 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.413655 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.413745 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.413964 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.414052 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.414206 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:02:22.414297 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.414583 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:22.414827 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:02:22.569751 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Registered counter for database nova_api Jun 20 06:02:22.569958 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Registered counter for database nova_api Jun 20 06:02:22.591618 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:22.594215 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:22.599384 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:22.600687 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:22.658480 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.context [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43279633-07ee-4e93-b9f3-9c7baabf2ceb(cell1) {{(pid=103348) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:02:22.658895 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.context [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43279633-07ee-4e93-b9f3-9c7baabf2ceb(cell1) {{(pid=103349) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:02:22.662336 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:22.662812 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:22.663930 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:22.664394 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:22.664702 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:22.665166 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:22.666656 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:22.667119 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:22.668614 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Registered counter for database nova_cell0 Jun 20 06:02:22.669055 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Registered counter for database nova_cell0 Jun 20 06:02:22.672643 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Registered counter for database nova_cell1 Jun 20 06:02:22.673132 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Registered counter for database nova_cell1 Jun 20 06:02:22.679702 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:22.682086 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:22.683400 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:22.684283 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:22.689233 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:22.691659 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:22.692036 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:22.696489 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:22.836221 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Registered counter for database nova_cell0 Jun 20 06:02:22.839708 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Registered counter for database nova_cell0 Jun 20 06:02:22.845586 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:22.849008 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:22.849965 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:22.853494 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:23.189572 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:23.192548 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:23.196864 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:23.199787 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:23.541111 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:23.542292 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:23.547214 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:23.548255 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:23.552471 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652063779c0 pid: 103349 (default app) Jun 20 06:02:23.553461 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652063779c0 pid: 103348 (default app) Jun 20 06:02:23.554535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:02:23.555713 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0b9e7601-1403-417d-a598-0a69521d4048 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 Jun 20 06:02:23.556130 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon Jun 20 06:02:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:38.581289 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:38.582526 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Jun 20 06:03:38.582948 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:38.598855 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:38.599801 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:38.601043 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell1:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:38.601936 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:39.034177 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-fb6a97e0-e693-4af5-9409-35fb37d5364d admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:39.065600 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-fb6a97e0-e693-4af5-9409-35fb37d5364d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476530 Jun 20 06:03:39.066416 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1291 bytes} [Mon Jun 20 06:03:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:41.166115 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:41.167108 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-06444778-0fb4-4e99-b62e-2ea13435444c None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 20 06:03:41.167715 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:41.231211 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-5353a7c4-a3ae-4d25-821c-81a34873fb5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "name": "cirros256", "ram": 256}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:41.250767 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:41.250767 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jun 20 06:03:41.284262 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-5353a7c4-a3ae-4d25-821c-81a34873fb5e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109767 Jun 20 06:03:41.285126 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:41.303741 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:41.304946 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:41.306176 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell1:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:41.309473 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:41.528583 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-5b6b129f-96ab-4192-9448-307a5751b4af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:41.531412 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:41.531412 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 20 06:03:41.592053 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-5b6b129f-96ab-4192-9448-307a5751b4af admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297212 Jun 20 06:03:41.598101 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:43.714216 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-5353a7c4-a3ae-4d25-821c-81a34873fb5e admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:43.715236 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-5353a7c4-a3ae-4d25-821c-81a34873fb5e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 20 06:03:43.715655 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:43.831487 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-1225ff96-e371-4cbf-bc13-81148bb3620c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:43.849361 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:43.849361 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 20 06:03:43.867901 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-1225ff96-e371-4cbf-bc13-81148bb3620c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145841 Jun 20 06:03:43.868453 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:43.881015 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-80c51382-9574-4c90-8898-3fc3c9350ffc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:43.882627 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:43.882627 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jun 20 06:03:43.915073 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-80c51382-9574-4c90-8898-3fc3c9350ffc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037740 Jun 20 06:03:43.915665 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:46.006137 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-1225ff96-e371-4cbf-bc13-81148bb3620c admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:46.007149 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-1225ff96-e371-4cbf-bc13-81148bb3620c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 20 06:03:46.008004 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:46.068827 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-21811192-44ce-4f81-a6c3-3a1b1feb5221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:46.087726 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-21811192-44ce-4f81-a6c3-3a1b1feb5221 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073341 Jun 20 06:03:46.093622 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:03:46.102124 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-95ce2a32-3161-4a8d-bf65-d9d49962c4b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:46.127193 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-95ce2a32-3161-4a8d-bf65-d9d49962c4b9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028973 Jun 20 06:03:46.128197 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:03:48.284556 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-21811192-44ce-4f81-a6c3-3a1b1feb5221 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:48.285609 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-21811192-44ce-4f81-a6c3-3a1b1feb5221 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 20 06:03:48.286019 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:48.347591 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-eea0c47e-9c9d-4bbb-b3e8-911a2e10f7e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:48.366296 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-eea0c47e-9c9d-4bbb-b3e8-911a2e10f7e6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074539 Jun 20 06:03:48.366844 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:03:48.378793 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-5dc9c6f7-1fea-480c-9061-effd8b4a433f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:48.401527 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-5dc9c6f7-1fea-480c-9061-effd8b4a433f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026291 Jun 20 06:03:48.402100 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:03:50.504361 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-eea0c47e-9c9d-4bbb-b3e8-911a2e10f7e6 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:50.505449 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-eea0c47e-9c9d-4bbb-b3e8-911a2e10f7e6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 20 06:03:50.505848 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:50.564757 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ed983cea-c544-478d-8520-266803fdfa0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:50.582376 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-ed983cea-c544-478d-8520-266803fdfa0a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070704 Jun 20 06:03:50.582927 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:50.595215 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f82af32f-a293-4a67-9bd2-7ebb2fd56d98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:50.618232 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-f82af32f-a293-4a67-9bd2-7ebb2fd56d98 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027200 Jun 20 06:03:50.618793 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:52.845779 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ed983cea-c544-478d-8520-266803fdfa0a admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:52.846796 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-ed983cea-c544-478d-8520-266803fdfa0a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jun 20 06:03:52.847201 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:52.911679 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-52a0b9b3-1c75-4b97-ab8f-7d1acf3f1487 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:52.935301 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-52a0b9b3-1c75-4b97-ab8f-7d1acf3f1487 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081978 Jun 20 06:03:52.936072 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1291 bytes} [Mon Jun 20 06:03:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:03:55.077330 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ed983cea-c544-478d-8520-266803fdfa0a admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:55.078542 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-ed983cea-c544-478d-8520-266803fdfa0a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jun 20 06:03:55.078960 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:55.139751 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-6527d8ab-e7ff-48f8-87d9-b64ef401898a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:55.159138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-6527d8ab-e7ff-48f8-87d9-b64ef401898a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074243 Jun 20 06:03:55.159693 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:03:55.172343 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-227d3417-fb65-4a47-96d1-00d058fc6608 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:55.197566 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-227d3417-fb65-4a47-96d1-00d058fc6608 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029241 Jun 20 06:03:55.198021 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jun 20 06:03:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:57.523881 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-6527d8ab-e7ff-48f8-87d9-b64ef401898a admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:57.524892 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-6527d8ab-e7ff-48f8-87d9-b64ef401898a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 20 06:03:57.525328 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:57.587344 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-e7dd15dc-3815-4f55-8a31-a1e08b6d79ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:57.605043 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-e7dd15dc-3815-4f55-8a31-a1e08b6d79ac admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073310 Jun 20 06:03:57.605634 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:57.617833 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-c44c5de3-0275-4751-90c0-f87fe424fad6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:57.642903 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-c44c5de3-0275-4751-90c0-f87fe424fad6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028542 Jun 20 06:03:57.643619 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jun 20 06:03:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:59.741332 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-e7dd15dc-3815-4f55-8a31-a1e08b6d79ac admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:59.742423 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-e7dd15dc-3815-4f55-8a31-a1e08b6d79ac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jun 20 06:03:59.742914 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:03:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:59.805310 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a976d60b-812d-406c-a1af-b76334066e06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:59.823149 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-a976d60b-812d-406c-a1af-b76334066e06 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074236 Jun 20 06:03:59.823711 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:59.836542 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-bf795696-9f86-4b8f-9831-37df62cc6ac9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:59.862619 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-bf795696-9f86-4b8f-9831-37df62cc6ac9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029987 Jun 20 06:03:59.863259 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jun 20 06:03:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:01.983589 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a976d60b-812d-406c-a1af-b76334066e06 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:01.984585 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-a976d60b-812d-406c-a1af-b76334066e06 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 20 06:04:01.984988 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:04:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:02.042867 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-6ac8bcb5-5a76-4b8e-ae2b-6df686b7edd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "disk": 80, "swap": 0, "id": "4"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:02.060530 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-6ac8bcb5-5a76-4b8e-ae2b-6df686b7edd0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069957 Jun 20 06:04:02.061149 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:04:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:04:02.072856 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-4678130b-c7c4-4eaf-a9fe-3ad3e9e48422 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:02.097965 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-4678130b-c7c4-4eaf-a9fe-3ad3e9e48422 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028645 Jun 20 06:04:02.098668 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jun 20 06:04:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:04.209896 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-6ac8bcb5-5a76-4b8e-ae2b-6df686b7edd0 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:04.211608 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-6ac8bcb5-5a76-4b8e-ae2b-6df686b7edd0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Jun 20 06:04:04.212029 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:04:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:04.274064 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-610cde18-3650-48e7-b180-1c6fb354d9f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "name": "m1.xlarge", "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:04.292973 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-610cde18-3650-48e7-b180-1c6fb354d9f0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074378 Jun 20 06:04:04.294266 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jun 20 06:04:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:04.306749 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-380cb3f7-839b-4017-8b74-f81572ef0cb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:04.352712 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-380cb3f7-839b-4017-8b74-f81572ef0cb0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049812 Jun 20 06:04:04.354088 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jun 20 06:04:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:04:28.833721 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-610cde18-3650-48e7-b180-1c6fb354d9f0 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:28.834867 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-610cde18-3650-48e7-b180-1c6fb354d9f0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jun 20 06:04:28.835346 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:04:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:28.847090 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:28.900435 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-a36e0885-53bd-43ac-aea0-61d5d02d1e52 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:28.918835 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-a36e0885-53bd-43ac-aea0-61d5d02d1e52 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076394 Jun 20 06:04:28.919369 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1291 bytes} [Mon Jun 20 06:04:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:29.858914 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-610cde18-3650-48e7-b180-1c6fb354d9f0 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:29.859915 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-610cde18-3650-48e7-b180-1c6fb354d9f0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 20 06:04:29.860332 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:30.049010 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-39c1cf56-aba5-43e4-8ae5-63c038c19173 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:30.054711 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-39c1cf56-aba5-43e4-8ae5-63c038c19173 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-39c1cf56-aba5-43e4-8ae5-63c038c19173 admin admin] Request method failure captured: Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Accept: application/json Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Host: 10.222.0.16 Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABisA3tOxMU1WjWB97fu37KE9RFgTSMP40ZxJ_cywytYXRVa3RkExN1sW4WqJ__GcdGXHoQFUxXGiYbJ80P76yNyCsqeavY7VIPAj_7Bll3xoNxmyZQTZZgT2VyQPIxXGVAdct_CbU83AWpbKgSYBqBBMUgckaw8NFHo8rFwdgOYYN4n08 Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Role: reader,member,admin Jun 20 06:04:30.057977 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Roles: reader,member,admin Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}] Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User: admin Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Id: 3192aad0e5c64158b978fa55eb9121d5 Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: method: > Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: exception: Flavor 42 could not be found. Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: action_args: {'id': '42'} Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:30.060220 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:30.061156 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.062601 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-39c1cf56-aba5-43e4-8ae5-63c038c19173 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:30.063867 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-39c1cf56-aba5-43e4-8ae5-63c038c19173 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062148 Jun 20 06:04:30.063867 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Jun 20 06:04:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:30.070024 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-2b5b0b7f-c9eb-46e1-9c75-587a471988e8 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:30.072934 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:30.092950 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-2b5b0b7f-c9eb-46e1-9c75-587a471988e8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026512 Jun 20 06:04:30.093519 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:30.103244 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-eba5e93b-ada1-4384-8f80-9ab916b8b801 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:30.126952 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-eba5e93b-ada1-4384-8f80-9ab916b8b801 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027272 Jun 20 06:04:30.127483 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:30.137269 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-aece4b05-71f8-458f-bbfd-745fa8e1c07e admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:30.143559 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-aece4b05-71f8-458f-bbfd-745fa8e1c07e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-aece4b05-71f8-458f-bbfd-745fa8e1c07e admin admin] Request method failure captured: Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Accept: application/json Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Host: 10.222.0.16 Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABisA3tOxMU1WjWB97fu37KE9RFgTSMP40ZxJ_cywytYXRVa3RkExN1sW4WqJ__GcdGXHoQFUxXGiYbJ80P76yNyCsqeavY7VIPAj_7Bll3xoNxmyZQTZZgT2VyQPIxXGVAdct_CbU83AWpbKgSYBqBBMUgckaw8NFHo8rFwdgOYYN4n08 Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Role: reader,member,admin Jun 20 06:04:30.146806 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Roles: reader,member,admin Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}] Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User: admin Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Id: 3192aad0e5c64158b978fa55eb9121d5 Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: method: > Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: exception: Flavor 42 could not be found. Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: action_args: {'id': '42'} Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:30.148354 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:30.149138 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:30.150209 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-aece4b05-71f8-458f-bbfd-745fa8e1c07e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:30.151363 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-aece4b05-71f8-458f-bbfd-745fa8e1c07e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015243 Jun 20 06:04:30.151363 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Jun 20 06:04:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 06:04:30.987700 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-eba5e93b-ada1-4384-8f80-9ab916b8b801 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:30.988728 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-eba5e93b-ada1-4384-8f80-9ab916b8b801 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 20 06:04:30.989145 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:31.182902 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-52040587-144e-40e6-bd2a-98d427284fe4 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:31.190399 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-52040587-144e-40e6-bd2a-98d427284fe4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-52040587-144e-40e6-bd2a-98d427284fe4 admin admin] Request method failure captured: Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Accept: application/json Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Host: 10.222.0.16 Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABisA3uzsc0-sW9OIAxH4K70868eeTJ_unnQABndjKJwlYJG-maTtv3KeQ6SNJHg8_cL6QOYeeyXonzpDGbvAmCJ_HTZL0_NCsAJjMQ-EFm5AIdLlHzvSqPZbQU_TAAgn9VO941gOoHhWkKiCGUNKZjJf-dMxdXfaiijMlnaJbb4GcrZ3c Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Role: reader,member,admin Jun 20 06:04:31.191916 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Roles: reader,member,admin Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}] Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User: admin Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Id: 3192aad0e5c64158b978fa55eb9121d5 Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: method: > Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: exception: Flavor 84 could not be found. Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: action_args: {'id': '84'} Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:31.193357 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:31.194297 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.195495 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-52040587-144e-40e6-bd2a-98d427284fe4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:31.196712 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-52040587-144e-40e6-bd2a-98d427284fe4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064449 Jun 20 06:04:31.196712 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Jun 20 06:04:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:31.203992 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f31ad1cc-6495-453f-af1f-cf67b4bb32ea admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:31.218454 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f31ad1cc-6495-453f-af1f-cf67b4bb32ea admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018404 Jun 20 06:04:31.218987 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:31.228473 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-53458d0a-7e09-444c-be7d-0289cbf1b5d8 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:31.242124 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-53458d0a-7e09-444c-be7d-0289cbf1b5d8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017167 Jun 20 06:04:31.242677 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:31.251598 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-fee3c1e9-e4fc-4a12-9677-ca72a0674c4a admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:31.256984 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-fee3c1e9-e4fc-4a12-9677-ca72a0674c4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-fee3c1e9-e4fc-4a12-9677-ca72a0674c4a admin admin] Request method failure captured: Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Accept: application/json Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Host: 10.222.0.16 Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABisA3uzsc0-sW9OIAxH4K70868eeTJ_unnQABndjKJwlYJG-maTtv3KeQ6SNJHg8_cL6QOYeeyXonzpDGbvAmCJ_HTZL0_NCsAJjMQ-EFm5AIdLlHzvSqPZbQU_TAAgn9VO941gOoHhWkKiCGUNKZjJf-dMxdXfaiijMlnaJbb4GcrZ3c Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Role: reader,member,admin Jun 20 06:04:31.258529 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Roles: reader,member,admin Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}] Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User: admin Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Id: 3192aad0e5c64158b978fa55eb9121d5 Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: method: > Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: exception: Flavor 84 could not be found. Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: action_args: {'id': '84'} Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:31.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:31.260932 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:31.262576 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-fee3c1e9-e4fc-4a12-9677-ca72a0674c4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:31.263575 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-fee3c1e9-e4fc-4a12-9677-ca72a0674c4a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011704 Jun 20 06:04:31.263575 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Jun 20 06:04:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:32.084047 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-53458d0a-7e09-444c-be7d-0289cbf1b5d8 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:32.085035 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-53458d0a-7e09-444c-be7d-0289cbf1b5d8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 20 06:04:32.085455 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:32.278186 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f9d1978f-0f0a-4add-9b0c-c37405b476c9 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:32.283995 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-f9d1978f-0f0a-4add-9b0c-c37405b476c9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f9d1978f-0f0a-4add-9b0c-c37405b476c9 admin admin] Request method failure captured: Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Accept: application/json Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Host: 10.222.0.16 Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABisA3wZt3L9-SyCWU8OjaVEkPHooBeWH6LVoZIKIPoA_AQy0Mj4L7NCpENeAj4Ofux5sVGLtV36UToy3TNJyD4pmQmjrCL37oYDKnsiL_HdMPd9Q2hSHHCWQDwqCzcWuwz6vtH1rCaki6NXEivfPlCdx6BPFwoAiQZZsc4lgsumxFWP7U Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Role: reader,member,admin Jun 20 06:04:32.285535 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Roles: reader,member,admin Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}] Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User: admin Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Id: 3192aad0e5c64158b978fa55eb9121d5 Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: method: > Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: exception: Flavor 451 could not be found. Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: action_args: {'id': '451'} Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:32.287034 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:32.287902 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.289023 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f9d1978f-0f0a-4add-9b0c-c37405b476c9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:32.290094 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f9d1978f-0f0a-4add-9b0c-c37405b476c9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060548 Jun 20 06:04:32.290094 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jun 20 06:04:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:32.297462 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a2bea592-ca0f-475b-9ad8-645ee6897592 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:32.310964 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-a2bea592-ca0f-475b-9ad8-645ee6897592 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018115 Jun 20 06:04:32.311496 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:32.320946 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:32.334918 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017395 Jun 20 06:04:32.335449 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:32.345208 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-8efefaa0-c679-448e-bc2e-342d6b80a436 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:32.350605 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-8efefaa0-c679-448e-bc2e-342d6b80a436 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-8efefaa0-c679-448e-bc2e-342d6b80a436 admin admin] Request method failure captured: Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Accept: application/json Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Host: 10.222.0.16 Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABisA3wZt3L9-SyCWU8OjaVEkPHooBeWH6LVoZIKIPoA_AQy0Mj4L7NCpENeAj4Ofux5sVGLtV36UToy3TNJyD4pmQmjrCL37oYDKnsiL_HdMPd9Q2hSHHCWQDwqCzcWuwz6vtH1rCaki6NXEivfPlCdx6BPFwoAiQZZsc4lgsumxFWP7U Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Role: reader,member,admin Jun 20 06:04:32.352079 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Roles: reader,member,admin Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f9a6bdb9ae7447fb41cd2764e1194d4"}]}] Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 4f9a6bdb9ae7447fb41cd2764e1194d4 Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User: admin Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Id: 3192aad0e5c64158b978fa55eb9121d5 Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: method: > Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: exception: Flavor 451 could not be found. Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: action_args: {'id': '451'} Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:32.353425 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:32.354396 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 20 06:04:32.356212 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-8efefaa0-c679-448e-bc2e-342d6b80a436 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:32.357183 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-8efefaa0-c679-448e-bc2e-342d6b80a436 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011780 Jun 20 06:04:32.357183 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jun 20 06:04:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:33.180293 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:33.181292 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 20 06:04:33.181721 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:33.374327 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-30b82e0c-0e70-450e-96e8-15f16fe3e0d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:33.392186 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-30b82e0c-0e70-450e-96e8-15f16fe3e0d5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069522 Jun 20 06:04:33.392714 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Jun 20 06:04:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:34.226987 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:34.227981 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 20 06:04:34.228400 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:34.420137 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e1816811-7235-46fb-be40-829572950423 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:34.436976 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-e1816811-7235-46fb-be40-829572950423 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069187 Jun 20 06:04:34.437499 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Jun 20 06:04:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:35.274481 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:35.275481 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 20 06:04:35.275877 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:35.467266 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-c4feb9a9-21c2-4bd7-808e-2182c650a3d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:35.484589 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-c4feb9a9-21c2-4bd7-808e-2182c650a3d9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069745 Jun 20 06:04:35.485068 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Jun 20 06:04:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:36.330152 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:36.331151 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 20 06:04:36.331544 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:36.520208 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-8bc55056-020c-4274-acac-53a691b77aa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:36.537732 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-8bc55056-020c-4274-acac-53a691b77aa5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068573 Jun 20 06:04:36.538274 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Jun 20 06:04:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:37.369841 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:37.370896 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 20 06:04:37.371287 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:37.562566 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-bb850f0b-7855-4e34-92ca-4ae67b6d0c2c admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:37.581566 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-bb850f0b-7855-4e34-92ca-4ae67b6d0c2c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071977 Jun 20 06:04:37.582032 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Jun 20 06:04:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:05:24.945626 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:24.946536 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4aaf80e3-5dfb-43d7-9817-d1d78daddb78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 20 06:05:24.946960 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jun 20 06:05:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:05:24.957782 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:25.006865 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-408ee60d-cdb2-42a3-89a9-f53b61f1207f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:25.026787 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-408ee60d-cdb2-42a3-89a9-f53b61f1207f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073838 Jun 20 06:05:25.027324 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1291 bytes} [Mon Jun 20 06:05:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:05:25.049766 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-a8ca61bd-1d9c-44b2-b2a4-aa184fb30364 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:25.053597 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=14 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:25.060264 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-a8ca61bd-1d9c-44b2-b2a4-aa184fb30364 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014057 Jun 20 06:05:25.060784 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1282 bytes} [Mon Jun 20 06:05:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:25.072631 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b0ded765-bea4-464d-9c4f-a721106e84bc admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:25.080481 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b0ded765-bea4-464d-9c4f-a721106e84bc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011928 Jun 20 06:05:25.080998 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1285 bytes} [Mon Jun 20 06:05:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:05:25.092102 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:25.100278 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011647 Jun 20 06:05:25.100793 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1285 bytes} [Mon Jun 20 06:05:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:25.112480 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f813fe9a-c55e-4ed8-b1f2-5f6c246cd948 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:25.120744 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-f813fe9a-c55e-4ed8-b1f2-5f6c246cd948 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011734 Jun 20 06:05:25.121294 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1282 bytes} [Mon Jun 20 06:05:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:09:06.982876 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:06.983886 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 20 06:09:06.984308 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:09:07.129720 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=6 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:07.243783 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-538ab4d6-ba0f-414c-9489-8c1a0318f96b admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:07.245615 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:07.245615 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 20 06:09:07.246825 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-538ab4d6-ba0f-414c-9489-8c1a0318f96b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:07.247271 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-538ab4d6-ba0f-414c-9489-8c1a0318f96b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:07.248056 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-538ab4d6-ba0f-414c-9489-8c1a0318f96b admin admin] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:07.248487 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-538ab4d6-ba0f-414c-9489-8c1a0318f96b admin admin] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:07.283032 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-538ab4d6-ba0f-414c-9489-8c1a0318f96b admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154742 Jun 20 06:09:07.283619 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jun 20 06:09:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:09:08.124775 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:08.125808 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 20 06:09:08.126217 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:09:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:08.327046 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a387f2be-8a26-4cac-8500-6574ad2d5c2d admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:08.328369 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:08.328369 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 20 06:09:08.329717 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-a387f2be-8a26-4cac-8500-6574ad2d5c2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:08.330227 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-a387f2be-8a26-4cac-8500-6574ad2d5c2d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:08.331040 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-a387f2be-8a26-4cac-8500-6574ad2d5c2d admin admin] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:08.331468 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-a387f2be-8a26-4cac-8500-6574ad2d5c2d admin admin] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:08.351980 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-a387f2be-8a26-4cac-8500-6574ad2d5c2d admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079719 Jun 20 06:09:08.352483 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jun 20 06:09:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:09:19.601244 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:19.602287 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 20 06:09:19.602687 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:19.747175 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:19.749189 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell1:SELECT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:19.749844 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=8 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:19.798601 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-3bae2d37-81dc-4275-ba3b-ed541ce4d4d6 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:19.799764 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:19.799764 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 20 06:09:19.800943 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-3bae2d37-81dc-4275-ba3b-ed541ce4d4d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:19.801401 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-3bae2d37-81dc-4275-ba3b-ed541ce4d4d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:19.802198 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-3bae2d37-81dc-4275-ba3b-ed541ce4d4d6 admin admin] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:19.802629 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-3bae2d37-81dc-4275-ba3b-ed541ce4d4d6 admin admin] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:19.828460 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-3bae2d37-81dc-4275-ba3b-ed541ce4d4d6 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085651 Jun 20 06:09:19.828930 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jun 20 06:09:19 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:09:20.679005 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:20.680016 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7d58fb3a-7a79-4a66-a59b-f6ee47702df5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 20 06:09:20.680561 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jun 20 06:09:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:20.870453 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-5b2aeca4-9da4-43fc-95c2-d6fec1d7eb08 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:20.871613 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:20.871613 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 20 06:09:20.872864 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-5b2aeca4-9da4-43fc-95c2-d6fec1d7eb08 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:20.873294 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-5b2aeca4-9da4-43fc-95c2-d6fec1d7eb08 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:20.874099 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-5b2aeca4-9da4-43fc-95c2-d6fec1d7eb08 admin admin] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:20.874518 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-5b2aeca4-9da4-43fc-95c2-d6fec1d7eb08 admin admin] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:20.896702 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-5b2aeca4-9da4-43fc-95c2-d6fec1d7eb08 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077208 Jun 20 06:09:20.897182 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jun 20 06:09:20 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:18.096132 dv-cinder-804735-31-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 06:10:18.096645 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: Mon Jun 20 06:10:18 2022 - graceful shutdown triggered... Jun 20 06:10:18.097076 dv-cinder-804735-31-iscsi devstack@n-api.service[103348]: Gracefully killing worker 1 (pid: 103348)... Jun 20 06:10:18.097460 dv-cinder-804735-31-iscsi devstack@n-api.service[103349]: Gracefully killing worker 2 (pid: 103349)... Jun 20 06:10:19.097587 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: worker 1 buried after 1 seconds Jun 20 06:10:19.098149 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: worker 2 buried after 1 seconds Jun 20 06:10:19.098149 dv-cinder-804735-31-iscsi devstack@n-api.service[103347]: goodbye to uWSGI. Jun 20 06:10:19.099209 dv-cinder-804735-31-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 20 06:10:19.099780 dv-cinder-804735-31-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 06:10:19.102590 dv-cinder-804735-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 06:10:19.112051 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 06:10:19.114670 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 06:10:19 2022] *** Jun 20 06:10:19.114824 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 06:10:19.114955 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 06:10:19.115075 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: nodename: dv-cinder-804735-31-iscsi Jun 20 06:10:19.115185 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: machine: x86_64 Jun 20 06:10:19.115311 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: clock source: unix Jun 20 06:10:19.115420 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: pcre jit disabled Jun 20 06:10:19.115527 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: detected number of CPU cores: 4 Jun 20 06:10:19.115634 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: current working directory: / Jun 20 06:10:19.115741 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: detected binary path: /usr/bin/uwsgi-core Jun 20 06:10:19.115854 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: your processes number limit is 47680 Jun 20 06:10:19.116143 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: your memory page size is 4096 bytes Jun 20 06:10:19.116266 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: detected max file descriptor number: 2048 Jun 20 06:10:19.116389 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: lock engine: pthread robust mutexes Jun 20 06:10:19.116665 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: thunder lock: enabled Jun 20 06:10:19.116984 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 06:10:19.117181 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 06:10:19.164910 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: Python main interpreter initialized at 0x55cbe8f019c0 Jun 20 06:10:19.164910 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: python threads support enabled Jun 20 06:10:19.164910 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: your server socket listen backlog is limited to 100 connections Jun 20 06:10:19.164910 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: your mercy for graceful operations on workers is 90 seconds Jun 20 06:10:19.165270 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 06:10:19.165353 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: *** Operational MODE: preforking *** Jun 20 06:10:19.165662 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: *** uWSGI is running in multiple interpreter mode *** Jun 20 06:10:19.165662 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: spawned uWSGI master process (pid: 117703) Jun 20 06:10:19.165859 dv-cinder-804735-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 06:10:19.166442 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: spawned uWSGI worker 1 (pid: 117726, cores: 1) Jun 20 06:10:19.173712 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: spawned uWSGI worker 2 (pid: 117727, cores: 1) Jun 20 06:10:19.173916 dv-cinder-804735-31-iscsi devstack@n-api.service[117703]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 06:10:19.829616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:10:19.847517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:10:21.042708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:10:21.042708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: from cryptography.utils import int_from_bytes Jun 20 06:10:21.043751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:10:21.043751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: from cryptography.utils import int_from_bytes Jun 20 06:10:21.083153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:10:21.083153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: from cryptography.utils import int_from_bytes Jun 20 06:10:21.083714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:10:21.083714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: from cryptography.utils import int_from_bytes Jun 20 06:10:23.478127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:10:23.478693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:10:23.478966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:10:23.479238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:10:23.479470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:10:23.480201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.480634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.481054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.481403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.481746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.482235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.482616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.483019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.483354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.483623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.483948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.484285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-31-iscsi {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.484617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.484927 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.485243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.485719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.486033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.486364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.486685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.487204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.488709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.488709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.488709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.488709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.489073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.489352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.489702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.490020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.490431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.490735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.491145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-31-iscsi {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.491466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.491788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.492112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.492539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.492884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.493196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.493552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.493903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.497896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.498206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.498539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.498847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.499147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.499478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.499810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.500143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.500400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.500660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.500987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.501316 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.501659 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.501769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:10:23.502183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.502268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:10:23.502344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.502549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:10:23.502719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.502870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.503048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:10:23.503212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:10:23.503385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.503536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.503692 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.503842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.503996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.504149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.504300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.504449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.504608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.504758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.504911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.505100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.505245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.505447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.505614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.505767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.505918 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.506069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.506222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.506383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.506526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.506679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.506831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.506982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.507136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-31-iscsi {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.507288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.507473 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.507623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.507773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.507916 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.508067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.508218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.508400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.508555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.508744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.508916 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.509081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.509262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.509440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.509614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.509757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.509941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.510123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.510291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.510445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.510594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.510738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.511653 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.511653 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.513120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.513120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.513440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.513599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.513756 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.513908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.514051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.514200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.514353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.514505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.514662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.514817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.514982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.515126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-31-iscsi {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.515276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.515276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.515563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.515713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.515857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.516007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.516157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.516316 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.516467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.516611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.516772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.517023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.517189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.517334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.517521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.517676 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.517827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.517970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.518126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.518277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.518427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.518579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.518731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.518893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.519049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.519049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.519327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.519484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.519627 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.520408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.520569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.520722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.520866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.521271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.521457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.521640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.521809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.521954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.522197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.522817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.523006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.523305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.523464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.523609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.523768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.523921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.524071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.524214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.524382 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.524527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.524685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.524840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.526342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.526489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.526587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.526692 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.526780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.526862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.526952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527385 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.527994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.528862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.529024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.529024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.529203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.529296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.529408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.529494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.529588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.529679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.529780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.529876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.529964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.529964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.530121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.530121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.530278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.530359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.530448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.530448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.530605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.530699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.530788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.530870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.530950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.530950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.531116 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.531212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.531296 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.531515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.531688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.531848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.532009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.532163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.532315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.532974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.533141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.533534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.533702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.533857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.534012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.534156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.534299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.534454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.534608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.534757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.534908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.535051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.535201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.535344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.535496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.535640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.535790 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.535942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.536093 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.536247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.536413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.536567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.536731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.536884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.537028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.537181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.537325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.537502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.537648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.537798 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.537942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.538094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.538094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.538385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.538528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.538678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.538828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.538981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.539132 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.539275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.539275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.539562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.539706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.539855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.539998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.540147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.540313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.540457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.540600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.540744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.540885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.541036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.541186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.541337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.541538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.541700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.541845 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.542063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.542229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.542381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.542713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.543217 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.543378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.543750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.543911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.543911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.544200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.544350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.544494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.544643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.544801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.544956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.545107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.545257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.545420 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.545570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.545730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.545882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.546027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.546169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.546319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.546471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.546627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.546779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.546941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.547098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.547242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.547475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.548119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.548285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.548437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.548589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.548733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.548892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.549044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.549195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.549345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:23.549546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.549693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.549846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.549991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.550135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.550278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.550429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.550573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.550748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.551076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.551239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.551384 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.551547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.551701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.551852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.551997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.552146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.552290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.552439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.552597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.552895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.553423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.553597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.553918 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.554090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.554263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.554419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.554563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.554705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.554847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.554998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.555156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.555300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.555451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.555601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.555752 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.555911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.556055 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.556217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.556368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.556519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.556668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.556820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.556963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.557106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.557106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.557405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.557565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.558456 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.558625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.558788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.558952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.559103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.559252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.559411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.559575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.559726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.559890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.560048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.560208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.560367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.560524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.560676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.560836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.561033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.561198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.561358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.561598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.561751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.561907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.562064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.562224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.562382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.562533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.562690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.562989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.563522 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.563693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.563864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.564192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.564344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.564501 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.564661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.564821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.564971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.565128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.565296 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.565598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.565773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.565943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.566110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.566262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.566421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.566579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.566749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.566908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.567065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.567223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.567373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.567533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.567698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.567848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.568018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.568177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.568327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.568491 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.568649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.568649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.568949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.568949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.569242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.569466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.569625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.569776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.569936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.570106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.570695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.570695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.571011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.571354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.571549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.571713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.571872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.572039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.572200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.572358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.572545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.572713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.572906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.574420 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.574602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.574889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.575052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.575204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.575376 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.575529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.575767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.575922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.576072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.576072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.576379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.576379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.576674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.576825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.576982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.577140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.577299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.577484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.577648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.577806 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.577964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.578123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.578288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.578456 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.578615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.578766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.578917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.579157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.579333 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.579495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.579646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.579796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.579946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.579946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.580242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.580402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.580561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.580720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.580872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.581655 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.581814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.582045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.582199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.582349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.582506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.582658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.583067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.583393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.583731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.584084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.584429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.584785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.584946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.585108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.585269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.585440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.585608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.585935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.586104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.586277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.586437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.586596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.586748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.586925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.587138 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.587304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.587462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.587613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.587764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.587924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.588091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.588243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.588411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.588569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.588721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.588890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.589063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.590305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.591037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.591224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.591391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.591733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.591898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.592059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.592343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.592508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.593014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.593736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.594086 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.594248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.594605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.595245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.595433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.595595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.595756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.595923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.596171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.596350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.596874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.597040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.597204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.597371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.597793 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.597958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.598126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.598286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.598438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.598596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.598818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.599002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.599154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.599313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.599475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.599625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.604181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.604391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.604624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.604797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.604973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.605140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.605316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.605527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.605705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.605865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.606021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.606161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.606286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.606421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.606556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.606684 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.606823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.606952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.607088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.607088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.607088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.607528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.607655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.607871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.608034 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.608034 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.608382 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.608541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.608662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.608820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.608975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.609238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.609586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.609711 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.609711 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.609904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.610654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.611959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.612882 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.613995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614279 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.614995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.615345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.615451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.615538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.615622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.615713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.615799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.615891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.615984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.616739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.617093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.617221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.617329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.618849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619158 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.619924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.620002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.620078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.620703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.620785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.620868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.620948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.621984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.622939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.623998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.624976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.625054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.625178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.625567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.625682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.625682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.625854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.625938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626603 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.626992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627074 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.627999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628524 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.628926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.629562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.629663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.629751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.629834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.629917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.629999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.630959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631430 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.631874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.632090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.632191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.632410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.632544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.632725 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.632827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.633045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.633144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.633358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.633487 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.633691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.633792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.634006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.634106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.634325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.634417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.634642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.634754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.634954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.635082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.635268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.635362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.635631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.636432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.636541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.636675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.636808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.636910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.637193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.637292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.637527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.637621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.637841 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.637939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.638158 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.638258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.638474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.638574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.638792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.638879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.639108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.639264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.639428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.639557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.639739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.639880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.640052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.640202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.640365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.640518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.640692 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.640838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.640994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.641187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.641288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.641506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.641612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.641832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.641916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.642148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.642258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.642533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.642631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.642847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.642940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.643159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.643258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.643474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.643668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.643819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.643970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.644132 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.644272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.644420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.644573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.644720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.644866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.645007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.645156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.645305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.645486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.645645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.646144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.646244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.646329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.646502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.646681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.646831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.646933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.647196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.647287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.647520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.647626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.647837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.647939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.648156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.648255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.648466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.648577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.648776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.648879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.649107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.649206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.649457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.649570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.649778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.649872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.650107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.650199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.650437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.650531 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.650769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.650863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.651081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.651181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.651426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.651524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.651756 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.651847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.652075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.652282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.652372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.652452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.652692 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.652789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.653011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.653117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.653330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.653479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.653677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.653775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.653998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.654100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.654318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.654463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.654632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.654785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.654948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.655119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.655268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.655454 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.655578 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.655915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.656035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.656129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.656214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.656395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.656495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.656709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.656817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.657026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.657127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.657359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.657477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.657706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.657810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.658034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.658151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.658355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.658474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.658691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.658792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.658986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.659099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.659370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.659495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.659628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.659780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.659942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.660038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.660275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.660377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.660592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.660683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.660922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.661014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.661254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.661363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662845 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.662929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.663128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.663261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.663363 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.663475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.663678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.663785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.664017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.664127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.664394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.664498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.664704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.664814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.665034 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.665134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.665488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.665593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.665805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.666112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.666220 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.666315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.666526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.666624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.666845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.666952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.667188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.667449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.667551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.667834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.667930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.668164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.668267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.668830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669806 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.669964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.670106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.670277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.670379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.670603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.670709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.670898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.670999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.671247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.671357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.671575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.671690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.671907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.672022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.672236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.672336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.672570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.672684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.672916 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.673022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.673253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.673358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.673611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.673721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.673921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.674023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.674236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.674362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.674554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.674721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.674875 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.675078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.675192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.675450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.675547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.675795 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.675900 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.676139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.676245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.676428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.676576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.676736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.676878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.677033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.677197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.677335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.677595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.677701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.677944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.678054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.678269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.678363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.678593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.678696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.678949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.679060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.679256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.679401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.679568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.679675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.679897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.680027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.680216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.680529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.680634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.680842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.680934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.681155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.681249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.681531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.681653 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.681894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.682002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.682176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.682356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.682515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.683269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.683484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.683743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.683842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.684071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.684172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.684391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.684486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.684712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.684805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.685051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.685152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.685434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.685602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.685765 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.685910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.686081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.686281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.686421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.686511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.686636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.686855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.686967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.687183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.687348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.687529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.687622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.687854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.687961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.688151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.688264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.688461 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.688606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.688789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.688991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.689088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.689342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.689470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.689693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.689801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.690062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.690210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.690358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.690470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.690674 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.690800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.691026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.691146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.691377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.691507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.691653 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.691756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.691975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.692081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.692293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.692396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.692625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.692729 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.692941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.693044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.693272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.693423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.693620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.693749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.693943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.694117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.694265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.694469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.694577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.694894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.695046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.695219 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.695397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.695541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.695759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.695855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.696120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.696266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.696502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.696611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.696788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.696888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.697153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.697347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.697540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.697730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.697878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.698051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.698256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.699179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.699283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.699525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.699623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.699868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.699965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.700196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.700292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.700523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.700636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.700842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.700943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.701161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.701261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.701500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.701596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.701835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.702114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.702226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.702490 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.702583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.702829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.702921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.703153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.703245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.703479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.703572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.703803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.703896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.704126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.704226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.704495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.704596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.704821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.704926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.705140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.705243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.705492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.705611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.705819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.705912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.706145 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.706289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.706468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.706595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.706788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.706882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.707112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.707206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.707460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.707561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.707768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.707868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.708074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.708168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.708399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.708503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.708720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.708820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.709055 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.709159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.709418 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.709579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.709750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.709950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.710065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.710266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.710408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.710605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.710703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.710963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.711207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.711300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.711528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.711627 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.711868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.711972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.712201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.712352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.713143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.713266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.713363 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.713502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.713590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.713673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.713745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.713995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.714359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.714486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.714630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.714731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.714944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.715037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.715265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.715357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.715582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.715680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.715895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.715991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.716229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.716351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.716610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.716718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.716866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.717087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.717202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.717465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.717581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.718057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.718167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.718401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.718521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.718725 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.718817 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.719066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.719241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.719396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.719535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.719712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.719835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.720029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.720137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.720362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.720493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.720677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.720817 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.720990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.721186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.721314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.721528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.721660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.721875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.721989 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.722252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.722385 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.722576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.722689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.722891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.722994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.723200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.723294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.723518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.723624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.723829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.723928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.724163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.724264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.724477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.724582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.724790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.724890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.725102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.725195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.725449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.725560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.725765 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.725867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.726078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.726169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.726390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.726502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.726750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.726872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.727017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.727116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.727329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.727428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.727645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.727750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.727956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.728055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.728321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.728431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.728581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.728683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.728895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.728987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.729236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.729348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.730085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.730184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.730413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.730600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.730744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.730916 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.731023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.731242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.731352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.731569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.731662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.731886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.731995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.732214 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.732315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.732627 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.732734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.732897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.732986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.733168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.733467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.733579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.733818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.733921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.734149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.734249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.734492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.734583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.734835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.734953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.735147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.735241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.735462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.735561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.735786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.735905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.736115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.736222 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.736433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.736546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.736905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.737067 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.737167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.737260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.737417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.737540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.737715 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.737910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.738037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.738224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.738357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.738540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.738731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.738915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.739015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.739228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.739363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.739546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.739640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.739859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.739961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.740171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.740280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.740486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.740598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.740797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.740893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.741110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.741202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.741448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.741558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.741767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.741869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.742077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.742180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.742405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.742498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.742726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.742859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.743040 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.743148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.743353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.743452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.743670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.743761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.744006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.744113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.744325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.744416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.744635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.744724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.744962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.745195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.745372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.745645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.745720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.745866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.745982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.746195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.746306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.746511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.746613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.746840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.746948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.747170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.747276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.747484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.747754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.747864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.747971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.748112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.748214 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.748448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.748542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.748769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.748862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.749088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.749180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.749444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.749543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.749761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.749861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.750073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.750164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.750386 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.750480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.750703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.750846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.751027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.751124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.751349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.751456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.751656 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.751752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.751965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.752066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.752282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.752385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.752594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.752697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.752911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.753038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.753222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.753422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.753549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.753780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.753894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.754084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.754178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.754457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.754578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.754768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.754860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.755083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.755207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.755404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.755508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.755700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.755881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.756015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.756186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.756324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.756538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.756648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.756859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.756952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.757234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.757340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.757566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.757671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.757906 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.758002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.758224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.758317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.758558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.758667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.758885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:10:23.758998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.759203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.759532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.759850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.760179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.760509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.761414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.761727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.762071 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.762386 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.762705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.763027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.763345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.763661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.763982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.764317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.764650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.764961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.765296 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.765648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.765975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.766304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.766622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.766963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.767305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.767591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.767913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.768228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.768544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.768867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.769185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.769544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.769880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.770202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.770530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.770866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.771476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.771808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.772143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.772480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.772803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.773125 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.773464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:23.773712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:10:23.824848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO dbcounter [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Registered counter for database nova_api Jun 20 06:10:23.837115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Registered counter for database nova_api Jun 20 06:10:23.846425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_db.sqlalchemy.engines [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:23.853023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writer thread running {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:23.857820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:23.864421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:23.911451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.context [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43279633-07ee-4e93-b9f3-9c7baabf2ceb(cell1) {{(pid=117726) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:10:23.915776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:23.917591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:23.918408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:23.920538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:23.922200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.context [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43279633-07ee-4e93-b9f3-9c7baabf2ceb(cell1) {{(pid=117727) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:10:23.922573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO dbcounter [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Registered counter for database nova_cell0 Jun 20 06:10:23.926407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:23.926622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO dbcounter [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Registered counter for database nova_cell1 Jun 20 06:10:23.928021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:23.928917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:23.930945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:23.933077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Registered counter for database nova_cell0 Jun 20 06:10:23.934056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_db.sqlalchemy.engines [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:23.935772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_db.sqlalchemy.engines [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:23.937392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Registered counter for database nova_cell1 Jun 20 06:10:23.941858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writer thread running {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:23.943948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writer thread running {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:23.944313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:23.945761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:23.953147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:23.954764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:24.100392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO dbcounter [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Registered counter for database nova_cell0 Jun 20 06:10:24.107080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_db.sqlalchemy.engines [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:24.109188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Registered counter for database nova_cell0 Jun 20 06:10:24.111705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writer thread running {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:24.116138 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:24.122440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:24.442848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: WARNING keystonemiddleware.auth_token [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:10:24.447465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:10:24.451018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: WARNING keystonemiddleware.auth_token [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:10:24.454853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:10:24.806245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: WARNING keystonemiddleware.auth_token [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:10:24.811737 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:10:24.813009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: WARNING keystonemiddleware.auth_token [None req-544014b9-8239-42c7-ad5b-c7cb6bfeeac9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:10:24.817739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-df0d8913-8659-4e9a-8f6d-b59d3288c8bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:10:24.818660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cbe8f019c0 pid: 117726 (default app) Jun 20 06:10:24.823059 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cbe8f019c0 pid: 117727 (default app) Jun 20 06:11:04.848928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.850240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.851162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:04.851944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.877074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.878299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.879048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.884709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:06.604922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d04f20e-4324-410c-a488-2d8303d373fd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Action: 'create', calling method: .version_select at 0x7f7a7c601700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1077022727"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:07.083335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0513e88f-4581-4fb6-af31-50287e75d4ec tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Action: 'create', calling method: .version_select at 0x7f7a7c600790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-235994965", "metadata": {"Type": "work"}}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:08.249264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6d04f20e-4324-410c-a488-2d8303d373fd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.435039 Jun 20 06:11:08.249948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1154 bytes} [Mon Jun 20 06:11:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3438 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 06:11:08.255560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6e328692-7be5-4e93-9032-f7ef07587430 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7c4c2550>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:08.458082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6e328692-7be5-4e93-9032-f7ef07587430 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1e895fd0-ef32-412e-aa62-0fbe3d40a32f" status: 200 len: 351 microversion: 2.1 time: 0.206752 Jun 20 06:11:08.465524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:08 2022] GET /compute/v2.1/os-volumes/1e895fd0-ef32-412e-aa62-0fbe3d40a32f => generated 351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:08.465524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4da7cbca-9c78-434f-9b1d-9ccbd0b919a8 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4c2820>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:09.228701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0513e88f-4581-4fb6-af31-50287e75d4ec tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.363058 Jun 20 06:11:09.230616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jun 20 06:11:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3366 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 06:11:09.243183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8688cfb-55e9-4f16-b902-45bcbfa3a4ed tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4c75e0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:09.391782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4da7cbca-9c78-434f-9b1d-9ccbd0b919a8 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 200 len: 346 microversion: 2.1 time: 0.931699 Jun 20 06:11:09.392345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:08 2022] GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 346 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:09.404169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ffb6ecb4-e2e6-4357-b7e6-aba23ed8cb5c tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Action: 'create', calling method: .version_select at 0x7f7a7c4c2d30>, body: {"snapshot": {"volume_id": "ea607d90-0cc6-4931-b206-0420d9d295d5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1210395200"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:09.783377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8688cfb-55e9-4f16-b902-45bcbfa3a4ed tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 353 microversion: 2.1 time: 0.545026 Jun 20 06:11:09.784502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 2/5] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:09 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 353 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:09.797416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d0811ab0-c591-4d20-a64d-cdfdeb9dde94 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4c7700>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:10.272785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ffb6ecb4-e2e6-4357-b7e6-aba23ed8cb5c tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.872694 Jun 20 06:11:10.273768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 4/6] 10.222.0.16 () {60 vars in 1161 bytes} [Mon Jun 20 06:11:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:10.288180 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-730c48a6-1fd2-4f98-bb95-733ba5b0d8d0 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4dd9d0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:10.397912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-730c48a6-1fd2-4f98-bb95-733ba5b0d8d0 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 287 microversion: 2.1 time: 0.116099 Jun 20 06:11:10.399271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 5/7] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:10 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:10.413908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9525a1ea-0fc2-4879-acf9-af8f1bc4023a tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4c2d30>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:10.428102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d0811ab0-c591-4d20-a64d-cdfdeb9dde94 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 353 microversion: 2.1 time: 0.636145 Jun 20 06:11:10.428698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 3/8] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:09 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 353 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:10.449404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-98bafe89-6579-4df9-8182-08372d174d2d tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4c7d30>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:10.532129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9525a1ea-0fc2-4879-acf9-af8f1bc4023a tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.125817 Jun 20 06:11:10.534690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 6/9] 10.222.0.16 () {58 vars in 1139 bytes} [Mon Jun 20 06:11:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:10.550979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2bf11816-073b-4d62-9be8-7d744df4a240 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4dda60>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:10.635105 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2bf11816-073b-4d62-9be8-7d744df4a240 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 287 microversion: 2.1 time: 0.094065 Jun 20 06:11:10.637174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 7/10] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:10 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:10.679198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-98bafe89-6579-4df9-8182-08372d174d2d tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 202 len: 0 microversion: 2.1 time: 0.236792 Jun 20 06:11:10.683676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 4/11] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:11:10 2022] DELETE /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:11:10.690240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a28ccdc2-0ead-47df-a9ff-63e59a2a747c tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4dd280>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:10.822245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a28ccdc2-0ead-47df-a9ff-63e59a2a747c tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 352 microversion: 2.1 time: 0.136576 Jun 20 06:11:10.829497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 8/12] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:10 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:11.503841 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-049b4cfc-4f1b-49b0-a0eb-2499d92e9208 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7c460430>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:11.642092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-049b4cfc-4f1b-49b0-a0eb-2499d92e9208 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bbd40ed3-293a-4ce8-99cd-cc982c400ef8" status: 200 len: 351 microversion: 2.1 time: 0.142947 Jun 20 06:11:11.647061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 5/13] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:11 2022] GET /compute/v2.1/os-volumes/bbd40ed3-293a-4ce8-99cd-cc982c400ef8 => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:11.648687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c215170b-ea85-4c10-8ee1-03afa6d2c2b9 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4c2310>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:11.752199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c215170b-ea85-4c10-8ee1-03afa6d2c2b9 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 287 microversion: 2.1 time: 0.107774 Jun 20 06:11:11.753737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 9/14] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:11 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:11.835124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-98a3dd1e-9ee9-407a-8b93-c21e9515f235 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4c7d30>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:11.945225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-98a3dd1e-9ee9-407a-8b93-c21e9515f235 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 352 microversion: 2.1 time: 0.113703 Jun 20 06:11:11.950735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 6/15] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:11 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:12.769522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3ac1cb6f-2437-4175-bc1a-e4671b63f18c tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4c2ee0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:12.958632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b0c9b7d4-8425-42ad-b892-5b290632acc2 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4c7700>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:12.968579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3ac1cb6f-2437-4175-bc1a-e4671b63f18c tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 287 microversion: 2.1 time: 0.206980 Jun 20 06:11:12.969481 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 10/16] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:12 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 287 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:13.085092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b0c9b7d4-8425-42ad-b892-5b290632acc2 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 352 microversion: 2.1 time: 0.130877 Jun 20 06:11:13.086479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 7/17] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:12 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:13.983162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eb58b7eb-fc50-4934-8e43-0bddb8044b13 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4dd1f0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:14.098753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-efbadce7-91c0-4bf2-a1d6-becccc1df65b tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4604c0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:14.143703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eb58b7eb-fc50-4934-8e43-0bddb8044b13 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 287 microversion: 2.1 time: 0.166010 Jun 20 06:11:14.148089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 11/18] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:13 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:14.227705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-efbadce7-91c0-4bf2-a1d6-becccc1df65b tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 352 microversion: 2.1 time: 0.132988 Jun 20 06:11:14.230920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 8/19] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:14 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:15.156884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-11d6294d-3273-4521-8a9b-e630148afb19 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4dda60>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:15.214955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-11d6294d-3273-4521-8a9b-e630148afb19 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 287 microversion: 2.1 time: 0.061906 Jun 20 06:11:15.215724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 12/20] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:15 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:15.243355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-700323a9-17d5-4cba-8cfa-470c43e6d070 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c460c10>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:15.346562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-700323a9-17d5-4cba-8cfa-470c43e6d070 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 352 microversion: 2.1 time: 0.108167 Jun 20 06:11:15.351938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 9/21] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:15 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:15.614993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1558061455", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:15.811835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] validate_networks() for [('3076d5e2-52b9-49c2-9946-ddaefc227754', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:16.227279 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-732ac344-2d64-4dcb-ab9d-ab499fc0b7bd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c460dc0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:16.307598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-732ac344-2d64-4dcb-ab9d-ab499fc0b7bd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 287 microversion: 2.1 time: 0.083627 Jun 20 06:11:16.309285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 10/22] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:16 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:16.359499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-380b009d-44fe-44de-b94d-a9bc091f5e4e tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4603a0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:16.463924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-380b009d-44fe-44de-b94d-a9bc091f5e4e tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 352 microversion: 2.1 time: 0.108166 Jun 20 06:11:16.464497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:16 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:17.239691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:17.242392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:17.243091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:17.243633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:17.246162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:17.268096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:17.268439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:17.269231 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:17.269729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:17.320635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Getting quotas for project 0614a239ccf84b5da75a269f3a0c6363. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:17.320975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8337411-e1f2-4c00-ad87-b32982f2af07 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7c4c7a60>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:17.329442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Getting quotas for user f49340b89c2a43b288572263ddac7be8 and project 0614a239ccf84b5da75a269f3a0c6363. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:17.351341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:17.355946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:17.377097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8337411-e1f2-4c00-ad87-b32982f2af07 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 287 microversion: 2.1 time: 0.059619 Jun 20 06:11:17.378453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:17 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:17.476216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9deebcdc-ca83-4e62-a656-e53ab4ad53f6 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7c4c7430>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:17.480081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-61f93daf-53cc-440a-8528-ebcbf33d65d2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.942383 Jun 20 06:11:17.481184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 13/25] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:17.491503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5c60c4fe-3b08-4773-a0a4-b68e21b0c638 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:17.492324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5c60c4fe-3b08-4773-a0a4-b68e21b0c638 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:17.561207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9deebcdc-ca83-4e62-a656-e53ab4ad53f6 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 200 len: 352 microversion: 2.1 time: 0.088955 Jun 20 06:11:17.562271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:17 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:17.702357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5c60c4fe-3b08-4773-a0a4-b68e21b0c638 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:17.724356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5c60c4fe-3b08-4773-a0a4-b68e21b0c638 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1222 microversion: 2.1 time: 0.237094 Jun 20 06:11:17.734131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:17 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1222 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:17.808090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2088829691", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:17.988141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] validate_networks() for [('3076d5e2-52b9-49c2-9946-ddaefc227754', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:18.398498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3a3c031c-d72e-4556-9c67-607a4ad0c609 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7bb70670>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:18.486645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3a3c031c-d72e-4556-9c67-607a4ad0c609 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 200 len: 288 microversion: 2.1 time: 0.101564 Jun 20 06:11:18.487834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:18 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:18.498628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-49e4b76e-1f3a-46ba-9120-5e5eb3e6d6b7 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7bb96790>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:18.651543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-49e4b76e-1f3a-46ba-9120-5e5eb3e6d6b7 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 202 len: 0 microversion: 2.1 time: 0.154921 Jun 20 06:11:18.655407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1253 bytes} [Mon Jun 20 06:11:18 2022] DELETE /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:11:18.663926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-faa30b80-1c9c-4666-925a-b3bf6c17b615 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Calling method '.version_select at 0x7f7a7bb70670>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:18.742188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-faa30b80-1c9c-4666-925a-b3bf6c17b615 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] HTTP exception thrown: Volume 9a820c3d-e753-458a-8489-d2930823187f could not be found. Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-faa30b80-1c9c-4666-925a-b3bf6c17b615 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Request method failure captured: Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f HTTP/1.1 Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA950FlsbiAYMDnvlmPhqiQJdpLPW3yPkpZnyaqdv1xaTuMabQZElcWEZdQ-qPGFqVPdsc9vqwj9E9v1wzr6Gmmmag8rdA4EMZgCeyGzL1knLZbOp9FPqJS1-SrbmCdYdRE_yCLj-A4o3KIatTZ6psgdw7hT_XFacX890NVS5nhZrEk Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: de264f07cfb24b5c9f7ad13032991167 Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesGetTestJSON-1379036667 Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:11:18.746986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de264f07cfb24b5c9f7ad13032991167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_de264f07cfb24b5c9f7ad13032991167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/de264f07cfb24b5c9f7ad13032991167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de264f07cfb24b5c9f7ad13032991167"}]}] Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesGetTestJSON-1379036667 Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: de264f07cfb24b5c9f7ad13032991167 Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesGetTestJSON-1379036667 Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesGetTestJSON-1379036667-project Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: e5749b58fdc647719dda3396a8939f2b Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesGetTestJSON-1379036667-project Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Volume 9a820c3d-e753-458a-8489-d2930823187f could not be found. Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '9a820c3d-e753-458a-8489-d2930823187f'} Jun 20 06:11:18.748220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a820c3d-e753-458a-8489-d2930823187f could not be found. (HTTP 404) (Request-ID: req-c72a8ce4-8005-4696-8492-4165492b29e8) Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:18.748990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:18.749978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a820c3d-e753-458a-8489-d2930823187f could not be found. Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:11:18.750862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a820c3d-e753-458a-8489-d2930823187f could not be found. Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a820c3d-e753-458a-8489-d2930823187f could not be found. Jun 20 06:11:18.751781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:18.759494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-faa30b80-1c9c-4666-925a-b3bf6c17b615 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] Returning 404 to user: Volume 9a820c3d-e753-458a-8489-d2930823187f could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:18.761021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-faa30b80-1c9c-4666-925a-b3bf6c17b615 tempest-VolumesGetTestJSON-1379036667 tempest-VolumesGetTestJSON-1379036667-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f" status: 404 len: 109 microversion: 2.1 time: 0.107228 Jun 20 06:11:18.767194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 17/30] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:18 2022] GET /compute/v2.1/os-volumes/9a820c3d-e753-458a-8489-d2930823187f => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:18.793326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e404fdfb-d02a-45a3-882e-17edfdc399cd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7ce29af0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.017304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-e404fdfb-d02a-45a3-882e-17edfdc399cd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] HTTP exception thrown: Snapshot d08bbff2-9d7e-4d7e-afb7-9da66cbca736 could not be found. Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e404fdfb-d02a-45a3-882e-17edfdc399cd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Request method failure captured: Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 HTTP/1.1 Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA94IjFJQxsBY0SkQE-xaoLVWrVuH09WHNktg3alGXmIjVvrIyGuQFpJpQyRPV5UfiuVFkLz4jckfpifLds5eFm5HgjKFHSqBr-OCgxMa0achXjg54Z8eHhhXIUuMvo1X2jNxlBjc6aR3o2_dYFKPb_dMmCD9NFsg3ZMFwdN9uL_A3c Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: ae107b7f471d424898d8412c63f536c7 Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:11:19.021840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae107b7f471d424898d8412c63f536c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae107b7f471d424898d8412c63f536c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae107b7f471d424898d8412c63f536c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae107b7f471d424898d8412c63f536c7"}]}] Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: ae107b7f471d424898d8412c63f536c7 Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotsTestJSON-573957090-project Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: af22088a85464ce49a57d7faeba7a576 Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573957090-project Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Snapshot d08bbff2-9d7e-4d7e-afb7-9da66cbca736 could not be found. Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'd08bbff2-9d7e-4d7e-afb7-9da66cbca736'} Jun 20 06:11:19.022918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d08bbff2-9d7e-4d7e-afb7-9da66cbca736 could not be found. (HTTP 404) (Request-ID: req-cec4ef22-7108-4d7c-a736-0d4ae1e2a2c6) Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.023573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:19.024429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d08bbff2-9d7e-4d7e-afb7-9da66cbca736 could not be found. Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 06:11:19.025865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d08bbff2-9d7e-4d7e-afb7-9da66cbca736 could not be found. Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d08bbff2-9d7e-4d7e-afb7-9da66cbca736 could not be found. Jun 20 06:11:19.027066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.028459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e404fdfb-d02a-45a3-882e-17edfdc399cd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Returning 404 to user: Snapshot d08bbff2-9d7e-4d7e-afb7-9da66cbca736 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:19.030287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e404fdfb-d02a-45a3-882e-17edfdc399cd tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736" status: 404 len: 111 microversion: 2.1 time: 0.258722 Jun 20 06:11:19.031114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 18/31] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:18 2022] GET /compute/v2.1/os-snapshots/d08bbff2-9d7e-4d7e-afb7-9da66cbca736 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:19.043413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3862e7e2-e1ba-4d79-8493-3dea325ddd3e tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7b30c0d0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.266541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3862e7e2-e1ba-4d79-8493-3dea325ddd3e tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5846f18b-db18-47db-8b9a-b6cc76d31889" status: 200 len: 351 microversion: 2.1 time: 0.233711 Jun 20 06:11:19.267063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 19/32] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:19 2022] GET /compute/v2.1/os-volumes/5846f18b-db18-47db-8b9a-b6cc76d31889 => generated 351 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:19.274327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-52fafae4-cec2-4917-8602-3df2017aaccb tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7b30c820>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.363341 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:19.363822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:19.364245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:19.364659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:19.366374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:19.389646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:19.390372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:19.399277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:19.401176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:19.411849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-52fafae4-cec2-4917-8602-3df2017aaccb tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 202 len: 0 microversion: 2.1 time: 0.143647 Jun 20 06:11:19.412535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 20/33] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:11:19 2022] DELETE /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:11:19.419505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-13dcd3bf-6978-42ff-83cf-c73bda0e0825 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7b356d30>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.480968 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Getting quotas for project 0614a239ccf84b5da75a269f3a0c6363. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:19.509760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Getting quotas for user f49340b89c2a43b288572263ddac7be8 and project 0614a239ccf84b5da75a269f3a0c6363. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:19.538568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:19.553369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:19.569503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-13dcd3bf-6978-42ff-83cf-c73bda0e0825 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.155459 Jun 20 06:11:19.570469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 21/34] 10.222.0.16 () {58 vars in 1133 bytes} [Mon Jun 20 06:11:19 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:19.576020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7ef071b1-8708-4f6b-acb9-60569a6d3cf1 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7ce29940>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.632598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7ef071b1-8708-4f6b-acb9-60569a6d3cf1 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 200 len: 345 microversion: 2.1 time: 0.060892 Jun 20 06:11:19.633329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 22/35] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:19 2022] GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:19.724670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-adc7374d-986d-4072-84ec-05f7e48cc45d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.924186 Jun 20 06:11:19.730186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 14/36] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:19.747115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3adae12d-5ceb-491b-9c74-f6805f123f14 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7bb6b0d0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.915664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3adae12d-5ceb-491b-9c74-f6805f123f14 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.183282 Jun 20 06:11:19.917726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 15/37] 10.222.0.16 () {58 vars in 1148 bytes} [Mon Jun 20 06:11:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:19.927863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-415f2cdc-f520-4077-89f8-834e641c9297 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'create', calling method: .version_select at 0x7f7a7b30c5e0>, body: {"keypair": {"name": "tempest-keypair-1233030990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJKgyGyxp5Jkx4GTN5GtLgkhn8Rx2u7BQwdmXLcszSc8g7zlWRbJih7oRE7agJKA/jLEVzkGPhd6plG/hUyuP4SYPeWhuC+R6Fl6mQLTT/FS9bofbYPkXsNqcmIVZ/E4A=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:19.974754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-415f2cdc-f520-4077-89f8-834e641c9297 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Getting quotas for project 018cb579b1dd49db9062d4ddab9c9154. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:19.982084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-415f2cdc-f520-4077-89f8-834e641c9297 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Getting quotas for user 14bf1845390b4c7880c04ae568aea00a and project 018cb579b1dd49db9062d4ddab9c9154. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:20.079360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-415f2cdc-f520-4077-89f8-834e641c9297 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.444537 Jun 20 06:11:20.079961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 23/38] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:11:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:20.090337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1c1204fd-a644-4d5d-8e9f-9ee502b2d9ae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:20.090958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1c1204fd-a644-4d5d-8e9f-9ee502b2d9ae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:20.178371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c1204fd-a644-4d5d-8e9f-9ee502b2d9ae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:20.191504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1c1204fd-a644-4d5d-8e9f-9ee502b2d9ae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1222 microversion: 2.1 time: 0.107650 Jun 20 06:11:20.197092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 24/39] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:20 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:20.237445 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c7e818b3-8288-40ce-a09c-5d507ebcdce3 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7b302af0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:20.426687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1367319530", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "networks": [{"uuid": "2ce0e00c-7f7f-4862-bd64-a26c35e90dda"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:20.460745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c7e818b3-8288-40ce-a09c-5d507ebcdce3 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.258057 Jun 20 06:11:20.467536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 25/40] 10.222.0.16 () {58 vars in 1133 bytes} [Mon Jun 20 06:11:20 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:20.475597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-36c8f58e-f0f6-41f0-9d8b-5eebd5db6513 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7b302a60>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:20.612136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] validate_networks() for [('2ce0e00c-7f7f-4862-bd64-a26c35e90dda', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:20.745437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-36c8f58e-f0f6-41f0-9d8b-5eebd5db6513 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.273730 Jun 20 06:11:20.746787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 26/41] 10.222.0.16 () {58 vars in 1166 bytes} [Mon Jun 20 06:11:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:20.751607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-79dc05d9-2ce1-43bd-b734-cf2545bc1fff tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7b356e50>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:20.843562 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-79dc05d9-2ce1-43bd-b734-cf2545bc1fff tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 200 len: 345 microversion: 2.1 time: 0.095697 Jun 20 06:11:20.844407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 27/42] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:20 2022] GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:20.849687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58c75a6d-81a0-4ff3-809b-2edbc9e64c24 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7bb96430>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:20.971668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-58c75a6d-81a0-4ff3-809b-2edbc9e64c24 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.126272 Jun 20 06:11:20.979787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 28/43] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Jun 20 06:11:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:20.985796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a61f41bd-f0b0-4604-acb5-01fc001786b8 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7b3569d0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.123366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a61f41bd-f0b0-4604-acb5-01fc001786b8 tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.141704 Jun 20 06:11:21.129510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 29/44] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Jun 20 06:11:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:21.137919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7da37cda-a018-4b59-9a72-d2a5928436bf tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7b302670>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.373607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7da37cda-a018-4b59-9a72-d2a5928436bf tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.241428 Jun 20 06:11:21.374808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 30/45] 10.222.0.16 () {58 vars in 1187 bytes} [Mon Jun 20 06:11:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:21.386966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-986f3532-e755-4a0b-9d14-8324cca260f6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.388006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-986f3532-e755-4a0b-9d14-8324cca260f6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:21.418894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-986f3532-e755-4a0b-9d14-8324cca260f6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.424430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-986f3532-e755-4a0b-9d14-8324cca260f6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.426385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-986f3532-e755-4a0b-9d14-8324cca260f6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.428161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-986f3532-e755-4a0b-9d14-8324cca260f6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.610003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:21.610985 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:21.612366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:21.612986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:21.613611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:21.630763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.631733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.633688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.634292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.705559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Getting quotas for project 0955a8e221d146fa90cea6bd42bddb53. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:21.739109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Getting quotas for user c94a1d536a0f491dab3cf34a5b1e2d9b and project 0955a8e221d146fa90cea6bd42bddb53. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:21.815679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:21.825842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:21.929554 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-986f3532-e755-4a0b-9d14-8324cca260f6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:21.953329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-986f3532-e755-4a0b-9d14-8324cca260f6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1226 microversion: 2.1 time: 0.574490 Jun 20 06:11:21.954934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 31/46] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:21 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1226 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:21.970241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-25439177-6636-476f-acdd-2730adb7c24b tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] Calling method '.version_select at 0x7f7a7b3025e0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.981010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-54916726-0d74-4753-b105-a7869d0f22e8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.060767 Jun 20 06:11:21.983074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 16/47] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:22.002947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-31769423-5f72-4045-a655-fb8004d757f1 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7bb7cd30>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:22.237582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-25439177-6636-476f-acdd-2730adb7c24b tempest-VolumesTestJSON-1709511125 tempest-VolumesTestJSON-1709511125-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.279709 Jun 20 06:11:22.238187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 32/48] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Jun 20 06:11:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:22.240689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-31769423-5f72-4045-a655-fb8004d757f1 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 200 len: 345 microversion: 2.1 time: 0.255617 Jun 20 06:11:22.241406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 17/49] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:21 2022] GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 345 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:22.244114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-84648138-7164-4fa5-9f8b-008f5afe8cc1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:22.245865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-84648138-7164-4fa5-9f8b-008f5afe8cc1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:22.434819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-84648138-7164-4fa5-9f8b-008f5afe8cc1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:22.446646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-84648138-7164-4fa5-9f8b-008f5afe8cc1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1215 microversion: 2.1 time: 0.207193 Jun 20 06:11:22.449945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 33/50] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:22 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:22.970963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1fe4cbe2-51d0-439d-a396-242d8e0c7541 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:22.971771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1fe4cbe2-51d0-439d-a396-242d8e0c7541 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:23.000852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fe4cbe2-51d0-439d-a396-242d8e0c7541 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:23.001555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fe4cbe2-51d0-439d-a396-242d8e0c7541 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:23.002685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fe4cbe2-51d0-439d-a396-242d8e0c7541 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:23.003362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fe4cbe2-51d0-439d-a396-242d8e0c7541 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:23.254407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a71755b5-b8a9-4357-b61b-81d212a5cb01 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7aa23af0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:23.393475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a71755b5-b8a9-4357-b61b-81d212a5cb01 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 200 len: 345 microversion: 2.1 time: 0.143134 Jun 20 06:11:23.394365 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 34/51] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:23 2022] GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:23.449708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1fe4cbe2-51d0-439d-a396-242d8e0c7541 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:23.472378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7d32cefc-c983-4359-99a9-8af55ff4ea39 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:23.473017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7d32cefc-c983-4359-99a9-8af55ff4ea39 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:23.495381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7d32cefc-c983-4359-99a9-8af55ff4ea39 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:23.508471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7d32cefc-c983-4359-99a9-8af55ff4ea39 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:23.510943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7d32cefc-c983-4359-99a9-8af55ff4ea39 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:23.511417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7d32cefc-c983-4359-99a9-8af55ff4ea39 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:23.511629 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1fe4cbe2-51d0-439d-a396-242d8e0c7541 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1226 microversion: 2.1 time: 0.530760 Jun 20 06:11:23.513566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 18/52] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:22 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1226 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:23.681763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-310142119", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a24e9929-a8f4-4e74-b08f-51c705db0e5f"}], "security_groups": [{"name": "tempest-securitygroup--39815091"}], "key_name": "tempest-keypair-1233030990", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:23.762354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7d32cefc-c983-4359-99a9-8af55ff4ea39 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:23.782280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7d32cefc-c983-4359-99a9-8af55ff4ea39 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1219 microversion: 2.1 time: 0.316827 Jun 20 06:11:23.786203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 35/53] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:23 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1219 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:24.006601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] validate_networks() for [('a24e9929-a8f4-4e74-b08f-51c705db0e5f', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:24.413992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9e6c51e1-e777-4185-8c5a-fef524ff0c7b tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7aa23280>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:24.464649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-9e6c51e1-e777-4185-8c5a-fef524ff0c7b tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] HTTP exception thrown: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9e6c51e1-e777-4185-8c5a-fef524ff0c7b tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Request method failure captured: Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 HTTP/1.1 Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA94IjFJQxsBY0SkQE-xaoLVWrVuH09WHNktg3alGXmIjVvrIyGuQFpJpQyRPV5UfiuVFkLz4jckfpifLds5eFm5HgjKFHSqBr-OCgxMa0achXjg54Z8eHhhXIUuMvo1X2jNxlBjc6aR3o2_dYFKPb_dMmCD9NFsg3ZMFwdN9uL_A3c Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: ae107b7f471d424898d8412c63f536c7 Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:11:24.467767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae107b7f471d424898d8412c63f536c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae107b7f471d424898d8412c63f536c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae107b7f471d424898d8412c63f536c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae107b7f471d424898d8412c63f536c7"}]}] Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: ae107b7f471d424898d8412c63f536c7 Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotsTestJSON-573957090-project Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: af22088a85464ce49a57d7faeba7a576 Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573957090-project Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'ea607d90-0cc6-4931-b206-0420d9d295d5'} Jun 20 06:11:24.468898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. (HTTP 404) (Request-ID: req-68314992-b14d-48d3-be1b-0cdbb57f21e2) Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:24.469737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:24.471142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:11:24.472072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.474286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.476405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9e6c51e1-e777-4185-8c5a-fef524ff0c7b tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Returning 404 to user: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:24.477898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9e6c51e1-e777-4185-8c5a-fef524ff0c7b tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 404 len: 109 microversion: 2.1 time: 0.071166 Jun 20 06:11:24.479254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 36/54] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:24 2022] GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:24.494844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d8cf9b51-8c84-4c12-af46-113311ed261d tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7aa38430>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:24.573910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-d8cf9b51-8c84-4c12-af46-113311ed261d tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] HTTP exception thrown: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d8cf9b51-8c84-4c12-af46-113311ed261d tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Request method failure captured: Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 HTTP/1.1 Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA94IjFJQxsBY0SkQE-xaoLVWrVuH09WHNktg3alGXmIjVvrIyGuQFpJpQyRPV5UfiuVFkLz4jckfpifLds5eFm5HgjKFHSqBr-OCgxMa0achXjg54Z8eHhhXIUuMvo1X2jNxlBjc6aR3o2_dYFKPb_dMmCD9NFsg3ZMFwdN9uL_A3c Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: ae107b7f471d424898d8412c63f536c7 Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:11:24.576335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae107b7f471d424898d8412c63f536c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae107b7f471d424898d8412c63f536c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae107b7f471d424898d8412c63f536c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae107b7f471d424898d8412c63f536c7"}]}] Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: ae107b7f471d424898d8412c63f536c7 Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotsTestJSON-573957090-project Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: af22088a85464ce49a57d7faeba7a576 Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573957090-project Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'ea607d90-0cc6-4931-b206-0420d9d295d5'} Jun 20 06:11:24.577483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. (HTTP 404) (Request-ID: req-1fa30951-d5f3-4aa9-8f72-b8e7ea50db65) Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:24.578149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:11:24.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:11:24.581364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d8cf9b51-8c84-4c12-af46-113311ed261d tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Returning 404 to user: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:24.584137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d8cf9b51-8c84-4c12-af46-113311ed261d tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 404 len: 109 microversion: 2.1 time: 0.088297 Jun 20 06:11:24.586752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 37/55] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:11:24 2022] DELETE /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:11:24.603858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4b87fd3a-0624-4060-847d-a1c811776f2b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:24.604497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4b87fd3a-0624-4060-847d-a1c811776f2b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:24.623693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b87fd3a-0624-4060-847d-a1c811776f2b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:24.625549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b87fd3a-0624-4060-847d-a1c811776f2b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:24.628945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b87fd3a-0624-4060-847d-a1c811776f2b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:24.630504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b87fd3a-0624-4060-847d-a1c811776f2b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:24.884533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4b87fd3a-0624-4060-847d-a1c811776f2b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:24.902180 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4b87fd3a-0624-4060-847d-a1c811776f2b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1282 microversion: 2.1 time: 0.314491 Jun 20 06:11:24.906754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 38/56] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:24 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1282 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:24.914466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f1e38ddb-7c09-497a-9ceb-1e4a017b2e19 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Calling method '.version_select at 0x7f7a7aa1e3a0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:24.950990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:24.952278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:24.953016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:24.953701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:24.954338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:24.965916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:24.966785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:24.968244 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:24.969093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:25.007673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-f1e38ddb-7c09-497a-9ceb-1e4a017b2e19 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] HTTP exception thrown: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f1e38ddb-7c09-497a-9ceb-1e4a017b2e19 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Request method failure captured: Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 HTTP/1.1 Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA94IjFJQxsBY0SkQE-xaoLVWrVuH09WHNktg3alGXmIjVvrIyGuQFpJpQyRPV5UfiuVFkLz4jckfpifLds5eFm5HgjKFHSqBr-OCgxMa0achXjg54Z8eHhhXIUuMvo1X2jNxlBjc6aR3o2_dYFKPb_dMmCD9NFsg3ZMFwdN9uL_A3c Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: ae107b7f471d424898d8412c63f536c7 Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:11:25.010115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae107b7f471d424898d8412c63f536c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae107b7f471d424898d8412c63f536c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae107b7f471d424898d8412c63f536c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae107b7f471d424898d8412c63f536c7"}]}] Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: ae107b7f471d424898d8412c63f536c7 Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573957090 Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotsTestJSON-573957090-project Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: af22088a85464ce49a57d7faeba7a576 Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573957090-project Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'ea607d90-0cc6-4931-b206-0420d9d295d5'} Jun 20 06:11:25.011654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. (HTTP 404) (Request-ID: req-50000148-58fc-40fa-a075-a5cc2ad4fa22) Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:25.012452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:25.013515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:11:25.015111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:11:25.016247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f1e38ddb-7c09-497a-9ceb-1e4a017b2e19 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] Returning 404 to user: Volume ea607d90-0cc6-4931-b206-0420d9d295d5 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:25.018364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f1e38ddb-7c09-497a-9ceb-1e4a017b2e19 tempest-VolumesSnapshotsTestJSON-573957090 tempest-VolumesSnapshotsTestJSON-573957090-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5" status: 404 len: 109 microversion: 2.1 time: 0.109497 Jun 20 06:11:25.019929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 39/57] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:24 2022] GET /compute/v2.1/os-volumes/ea607d90-0cc6-4931-b206-0420d9d295d5 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:25.030466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Getting quotas for project 018cb579b1dd49db9062d4ddab9c9154. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:25.031854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f5badfd6-3a7f-4d8c-bbe2-3201089eb4af tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:25.036609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f5badfd6-3a7f-4d8c-bbe2-3201089eb4af tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:25.041282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Getting quotas for user 14bf1845390b4c7880c04ae568aea00a and project 018cb579b1dd49db9062d4ddab9c9154. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:25.058248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5badfd6-3a7f-4d8c-bbe2-3201089eb4af tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:25.059817 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5badfd6-3a7f-4d8c-bbe2-3201089eb4af tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:25.064619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5badfd6-3a7f-4d8c-bbe2-3201089eb4af tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:25.065682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5badfd6-3a7f-4d8c-bbe2-3201089eb4af tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:25.092856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:25.095120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:25.255359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0dca0f09-3f7d-43cc-9132-13fd9b7b4770 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.579776 Jun 20 06:11:25.270091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 19/58] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:23 2022] POST /compute/v2.1/servers => generated 400 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:25.291683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d81a9af9-ca1d-42f1-a472-1cc61e6149c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:25.300703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d81a9af9-ca1d-42f1-a472-1cc61e6149c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:25.596928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d81a9af9-ca1d-42f1-a472-1cc61e6149c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:25.615728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d81a9af9-ca1d-42f1-a472-1cc61e6149c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1237 microversion: 2.1 time: 0.338578 Jun 20 06:11:25.627624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 20/59] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:25 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1237 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:25.665153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f5badfd6-3a7f-4d8c-bbe2-3201089eb4af tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:25.678497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f5badfd6-3a7f-4d8c-bbe2-3201089eb4af tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1275 microversion: 2.1 time: 0.656100 Jun 20 06:11:25.683316 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 40/60] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:25 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1275 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:25.924330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f1c4b657-917a-4d0e-9d72-3b33f1efab61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:25.925640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f1c4b657-917a-4d0e-9d72-3b33f1efab61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:25.945409 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1c4b657-917a-4d0e-9d72-3b33f1efab61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:25.946119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1c4b657-917a-4d0e-9d72-3b33f1efab61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:25.949039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1c4b657-917a-4d0e-9d72-3b33f1efab61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:25.957655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1c4b657-917a-4d0e-9d72-3b33f1efab61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:26.249740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f1c4b657-917a-4d0e-9d72-3b33f1efab61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:26.263357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f1c4b657-917a-4d0e-9d72-3b33f1efab61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1280 microversion: 2.1 time: 0.342685 Jun 20 06:11:26.263954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 21/61] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:25 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1280 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:26.634267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d74bbcc8-e948-4536-b172-7b2f47da9c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:26.634989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d74bbcc8-e948-4536-b172-7b2f47da9c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:26.655040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d74bbcc8-e948-4536-b172-7b2f47da9c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:26.659828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d74bbcc8-e948-4536-b172-7b2f47da9c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:26.663608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d74bbcc8-e948-4536-b172-7b2f47da9c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:26.665499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d74bbcc8-e948-4536-b172-7b2f47da9c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:26.702198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ef465a04-f1d7-405d-b2c1-3387d3f7baf1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:26.702950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ef465a04-f1d7-405d-b2c1-3387d3f7baf1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:26.716810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef465a04-f1d7-405d-b2c1-3387d3f7baf1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:26.722786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef465a04-f1d7-405d-b2c1-3387d3f7baf1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:26.726306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef465a04-f1d7-405d-b2c1-3387d3f7baf1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:26.730582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef465a04-f1d7-405d-b2c1-3387d3f7baf1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:27.299081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:27.608548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d74bbcc8-e948-4536-b172-7b2f47da9c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:27.624865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d74bbcc8-e948-4536-b172-7b2f47da9c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1241 microversion: 2.1 time: 0.995935 Jun 20 06:11:27.640140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 41/62] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:26 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1241 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:27.668913 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-093274f3-8737-4eb6-bcf7-334bd2cf463a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:27.669786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-093274f3-8737-4eb6-bcf7-334bd2cf463a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:27.715697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-093274f3-8737-4eb6-bcf7-334bd2cf463a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:27.724844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-093274f3-8737-4eb6-bcf7-334bd2cf463a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:27.730498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-093274f3-8737-4eb6-bcf7-334bd2cf463a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:27.733049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-093274f3-8737-4eb6-bcf7-334bd2cf463a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:27.788158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ef465a04-f1d7-405d-b2c1-3387d3f7baf1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:27.828292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ef465a04-f1d7-405d-b2c1-3387d3f7baf1 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1273 microversion: 2.1 time: 1.124148 Jun 20 06:11:27.836674 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 22/63] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:26 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1273 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:28.643288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-093274f3-8737-4eb6-bcf7-334bd2cf463a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:28.656905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b3551c88-66ac-4e52-8db7-796da9fbeb21 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:28.658275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b3551c88-66ac-4e52-8db7-796da9fbeb21 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:28.680519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-093274f3-8737-4eb6-bcf7-334bd2cf463a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1280 microversion: 2.1 time: 1.028288 Jun 20 06:11:28.683182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 42/64] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:27 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1280 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:28.697780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3551c88-66ac-4e52-8db7-796da9fbeb21 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.700807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3551c88-66ac-4e52-8db7-796da9fbeb21 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.702065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3551c88-66ac-4e52-8db7-796da9fbeb21 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.702945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3551c88-66ac-4e52-8db7-796da9fbeb21 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.850513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b0a91cb3-b6c0-43b9-84cd-4d10b3920378 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:28.854539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b0a91cb3-b6c0-43b9-84cd-4d10b3920378 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:28.870815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b0a91cb3-b6c0-43b9-84cd-4d10b3920378 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.871505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b0a91cb3-b6c0-43b9-84cd-4d10b3920378 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.874203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b0a91cb3-b6c0-43b9-84cd-4d10b3920378 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.877475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b0a91cb3-b6c0-43b9-84cd-4d10b3920378 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.971338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b3551c88-66ac-4e52-8db7-796da9fbeb21 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:28.983463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b3551c88-66ac-4e52-8db7-796da9fbeb21 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1295 microversion: 2.1 time: 0.327908 Jun 20 06:11:28.987943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 23/65] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:28 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1295 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:29.344642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b0a91cb3-b6c0-43b9-84cd-4d10b3920378 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:29.357276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b0a91cb3-b6c0-43b9-84cd-4d10b3920378 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1273 microversion: 2.1 time: 0.510324 Jun 20 06:11:29.358668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 43/66] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:28 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1273 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:29.704852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-16b4abe7-e4f2-4e7f-a790-6343ba01dea6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:29.709727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-16b4abe7-e4f2-4e7f-a790-6343ba01dea6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:29.722422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16b4abe7-e4f2-4e7f-a790-6343ba01dea6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:29.723725 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16b4abe7-e4f2-4e7f-a790-6343ba01dea6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:29.726018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16b4abe7-e4f2-4e7f-a790-6343ba01dea6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:29.730573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16b4abe7-e4f2-4e7f-a790-6343ba01dea6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:30.007137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bdcb2299-c477-4d43-b541-2fa677cacdc2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:30.008812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bdcb2299-c477-4d43-b541-2fa677cacdc2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:30.038451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bdcb2299-c477-4d43-b541-2fa677cacdc2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:30.041623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bdcb2299-c477-4d43-b541-2fa677cacdc2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:30.045685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bdcb2299-c477-4d43-b541-2fa677cacdc2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:30.046696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bdcb2299-c477-4d43-b541-2fa677cacdc2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:30.271327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-16b4abe7-e4f2-4e7f-a790-6343ba01dea6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:30.289977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-16b4abe7-e4f2-4e7f-a790-6343ba01dea6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1280 microversion: 2.1 time: 0.589036 Jun 20 06:11:30.303877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 24/67] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:29 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1280 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:30.345433 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bdcb2299-c477-4d43-b541-2fa677cacdc2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:30.369616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bdcb2299-c477-4d43-b541-2fa677cacdc2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1295 microversion: 2.1 time: 0.363134 Jun 20 06:11:30.376984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5fc27887-d860-4681-aeb2-aafc69550e0a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:30.377742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5fc27887-d860-4681-aeb2-aafc69550e0a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:30.393177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fc27887-d860-4681-aeb2-aafc69550e0a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:30.395560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 44/68] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:30 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1295 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:30.411508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fc27887-d860-4681-aeb2-aafc69550e0a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:30.433188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fc27887-d860-4681-aeb2-aafc69550e0a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:30.435080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fc27887-d860-4681-aeb2-aafc69550e0a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:31.316587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5a591f96-6d17-4176-ad96-70c3ad82d5e6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:31.321650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5a591f96-6d17-4176-ad96-70c3ad82d5e6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:31.345227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a591f96-6d17-4176-ad96-70c3ad82d5e6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:31.345976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a591f96-6d17-4176-ad96-70c3ad82d5e6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:31.347405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a591f96-6d17-4176-ad96-70c3ad82d5e6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:31.348048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a591f96-6d17-4176-ad96-70c3ad82d5e6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:31.698259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fc27887-d860-4681-aeb2-aafc69550e0a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:31.715780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5fc27887-d860-4681-aeb2-aafc69550e0a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 1.343912 Jun 20 06:11:31.717352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 25/69] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:30 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:31.729348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c2ef777a-d51b-400d-9b2d-d7bfd20ce2d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:31.730138 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c2ef777a-d51b-400d-9b2d-d7bfd20ce2d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:31.753132 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2ef777a-d51b-400d-9b2d-d7bfd20ce2d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:31.755389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2ef777a-d51b-400d-9b2d-d7bfd20ce2d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:31.758901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2ef777a-d51b-400d-9b2d-d7bfd20ce2d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:31.761056 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2ef777a-d51b-400d-9b2d-d7bfd20ce2d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:31.924586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a591f96-6d17-4176-ad96-70c3ad82d5e6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:31.954384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5a591f96-6d17-4176-ad96-70c3ad82d5e6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1280 microversion: 2.1 time: 0.644638 Jun 20 06:11:31.955170 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 45/70] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:31 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1280 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:32.545455 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c2ef777a-d51b-400d-9b2d-d7bfd20ce2d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:32.560251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c2ef777a-d51b-400d-9b2d-d7bfd20ce2d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.841566 Jun 20 06:11:32.561162 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 26/71] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:31 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:32.738890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-68911768-a217-470a-bc1a-6b7bc6e394f9 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:32.739539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-68911768-a217-470a-bc1a-6b7bc6e394f9 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:32.748246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=16 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:32.773761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68911768-a217-470a-bc1a-6b7bc6e394f9 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:32.775200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68911768-a217-470a-bc1a-6b7bc6e394f9 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:32.783303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68911768-a217-470a-bc1a-6b7bc6e394f9 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:32.783761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68911768-a217-470a-bc1a-6b7bc6e394f9 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:32.972017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b22f2e9a-dbf0-493f-a5f7-b0b01d98e98a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:32.973249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b22f2e9a-dbf0-493f-a5f7-b0b01d98e98a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:32.980462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b22f2e9a-dbf0-493f-a5f7-b0b01d98e98a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:32.984271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b22f2e9a-dbf0-493f-a5f7-b0b01d98e98a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:32.986567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b22f2e9a-dbf0-493f-a5f7-b0b01d98e98a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:32.995611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b22f2e9a-dbf0-493f-a5f7-b0b01d98e98a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:33.281819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b22f2e9a-dbf0-493f-a5f7-b0b01d98e98a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:33.293615 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b22f2e9a-dbf0-493f-a5f7-b0b01d98e98a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1280 microversion: 2.1 time: 0.325665 Jun 20 06:11:33.316580 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 27/72] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:32 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1280 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:33.584449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-755847cc-ad16-4d99-9240-c57a300937c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:33.585443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-755847cc-ad16-4d99-9240-c57a300937c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:33.604800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-755847cc-ad16-4d99-9240-c57a300937c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:33.605976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-755847cc-ad16-4d99-9240-c57a300937c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:33.618842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-755847cc-ad16-4d99-9240-c57a300937c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:33.620621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-755847cc-ad16-4d99-9240-c57a300937c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:33.738690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-68911768-a217-470a-bc1a-6b7bc6e394f9 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:33.786925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-68911768-a217-470a-bc1a-6b7bc6e394f9 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 1.050391 Jun 20 06:11:33.791717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 46/73] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:32 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:34.316722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-88532bc3-033c-4570-9b58-564925bbcb4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:34.317802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-88532bc3-033c-4570-9b58-564925bbcb4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:34.344710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88532bc3-033c-4570-9b58-564925bbcb4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:34.348069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88532bc3-033c-4570-9b58-564925bbcb4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:34.350476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88532bc3-033c-4570-9b58-564925bbcb4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:34.352836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88532bc3-033c-4570-9b58-564925bbcb4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:34.982088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:35.049135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-755847cc-ad16-4d99-9240-c57a300937c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:35.061267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-755847cc-ad16-4d99-9240-c57a300937c4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 1.486293 Jun 20 06:11:35.070027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 28/74] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:33 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:35.088753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-346039cb-7b8b-4f41-9303-c09d3bf805b5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:35.091388 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-346039cb-7b8b-4f41-9303-c09d3bf805b5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:35.107333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-346039cb-7b8b-4f41-9303-c09d3bf805b5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:35.110682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-346039cb-7b8b-4f41-9303-c09d3bf805b5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:35.111561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-346039cb-7b8b-4f41-9303-c09d3bf805b5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:35.114318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-346039cb-7b8b-4f41-9303-c09d3bf805b5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:35.595792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-88532bc3-033c-4570-9b58-564925bbcb4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:35.610535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=20 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:35.622263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-88532bc3-033c-4570-9b58-564925bbcb4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 1.314714 Jun 20 06:11:35.637606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 47/75] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:34 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:35.774012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-346039cb-7b8b-4f41-9303-c09d3bf805b5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:35.794784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-346039cb-7b8b-4f41-9303-c09d3bf805b5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.716061 Jun 20 06:11:35.807009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 29/76] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:35 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:36.086041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c902aa9-6e10-42f0-af01-19a12d174ae9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:36.086681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c902aa9-6e10-42f0-af01-19a12d174ae9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:36.116594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c902aa9-6e10-42f0-af01-19a12d174ae9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:36.117041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c902aa9-6e10-42f0-af01-19a12d174ae9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:36.122416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c902aa9-6e10-42f0-af01-19a12d174ae9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:36.126746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c902aa9-6e10-42f0-af01-19a12d174ae9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:36.651411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-96d3c68c-0f07-498a-980e-2494d4b64c97 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:36.652089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-96d3c68c-0f07-498a-980e-2494d4b64c97 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:36.675165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96d3c68c-0f07-498a-980e-2494d4b64c97 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:36.676114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96d3c68c-0f07-498a-980e-2494d4b64c97 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:36.683378 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96d3c68c-0f07-498a-980e-2494d4b64c97 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:36.685684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96d3c68c-0f07-498a-980e-2494d4b64c97 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:37.695039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c902aa9-6e10-42f0-af01-19a12d174ae9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:37.728992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c902aa9-6e10-42f0-af01-19a12d174ae9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 1.647818 Jun 20 06:11:37.730247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 48/77] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:36 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:37.890730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-96d3c68c-0f07-498a-980e-2494d4b64c97 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:37.910253 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-96d3c68c-0f07-498a-980e-2494d4b64c97 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 1.269403 Jun 20 06:11:37.910696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 30/78] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:36 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:37.930388 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0caf8b45-418f-4b79-9c89-603345a9134c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:37.956369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0caf8b45-418f-4b79-9c89-603345a9134c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:37.983286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0caf8b45-418f-4b79-9c89-603345a9134c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:37.989892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0caf8b45-418f-4b79-9c89-603345a9134c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:37.990770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0caf8b45-418f-4b79-9c89-603345a9134c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:37.993475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0caf8b45-418f-4b79-9c89-603345a9134c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:38.056852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-9516e3c5-f549-451a-8fd3-9696d3b529cc req-aa06739d-ba70-4116-b4bc-95411f7ff51b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aba062d-1d92-4ba5-9b14-c68ed8a468db", "tag": "70e2fd66-d29c-4794-8f34-64715e0b1b55"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:38.090322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-9516e3c5-f549-451a-8fd3-9696d3b529cc req-aa06739d-ba70-4116-b4bc-95411f7ff51b service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:38.091552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-9516e3c5-f549-451a-8fd3-9696d3b529cc req-aa06739d-ba70-4116-b4bc-95411f7ff51b service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:38.180652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-9516e3c5-f549-451a-8fd3-9696d3b529cc req-aa06739d-ba70-4116-b4bc-95411f7ff51b service nova] Creating event network-changed:70e2fd66-d29c-4794-8f34-64715e0b1b55 for instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db on hv-cinder-80473 Jun 20 06:11:38.182295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-9516e3c5-f549-451a-8fd3-9696d3b529cc req-aa06739d-ba70-4116-b4bc-95411f7ff51b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 06:11:38.184301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f496535-e42a-4ad6-86ea-d6fa8628ad36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:38.187946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f496535-e42a-4ad6-86ea-d6fa8628ad36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:38.189071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f496535-e42a-4ad6-86ea-d6fa8628ad36 None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:38.192186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f496535-e42a-4ad6-86ea-d6fa8628ad36 None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:38.234625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.compute.rpcapi [None req-3f496535-e42a-4ad6-86ea-d6fa8628ad36 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 06:11:38.248473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f496535-e42a-4ad6-86ea-d6fa8628ad36 None None] Releasing lock "compute-rpcapi-router" {{(pid=117726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 06:11:38.291605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3f496535-e42a-4ad6-86ea-d6fa8628ad36 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.558866 Jun 20 06:11:38.292551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 49/79] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:38.833159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-e99ae6cd-2dc2-4666-8546-e03526223d43 req-c5d405f1-e1b2-49aa-b7e6-7659705247ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7697c07f-5fd2-4b76-87af-0cb70746a73e", "tag": "6ace4e19-63bf-4af0-8997-ab7c43711b52"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:38.868821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e99ae6cd-2dc2-4666-8546-e03526223d43 req-c5d405f1-e1b2-49aa-b7e6-7659705247ed service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:38.870695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e99ae6cd-2dc2-4666-8546-e03526223d43 req-c5d405f1-e1b2-49aa-b7e6-7659705247ed service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:38.910826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-e99ae6cd-2dc2-4666-8546-e03526223d43 req-c5d405f1-e1b2-49aa-b7e6-7659705247ed service nova] Creating event network-changed:6ace4e19-63bf-4af0-8997-ab7c43711b52 for instance 7697c07f-5fd2-4b76-87af-0cb70746a73e on hv-cinder-80473 Jun 20 06:11:38.926028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-e99ae6cd-2dc2-4666-8546-e03526223d43 req-c5d405f1-e1b2-49aa-b7e6-7659705247ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.630148 Jun 20 06:11:38.930349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 50/80] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:38.948914 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0e3729ca-2a78-4300-8ce0-a3e935b89032 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:38.949665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0e3729ca-2a78-4300-8ce0-a3e935b89032 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:38.973521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0e3729ca-2a78-4300-8ce0-a3e935b89032 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:38.973989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0e3729ca-2a78-4300-8ce0-a3e935b89032 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:38.979167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0e3729ca-2a78-4300-8ce0-a3e935b89032 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:38.983108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0e3729ca-2a78-4300-8ce0-a3e935b89032 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:39.021632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0caf8b45-418f-4b79-9c89-603345a9134c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:39.032852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0caf8b45-418f-4b79-9c89-603345a9134c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 1.121041 Jun 20 06:11:39.035542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 31/81] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:37 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:39.069089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-377fc5ca-14d9-4dcd-b85a-6797d1cc6e10 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:39.070732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-377fc5ca-14d9-4dcd-b85a-6797d1cc6e10 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:39.101200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-377fc5ca-14d9-4dcd-b85a-6797d1cc6e10 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:39.101695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-377fc5ca-14d9-4dcd-b85a-6797d1cc6e10 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:39.102500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-377fc5ca-14d9-4dcd-b85a-6797d1cc6e10 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:39.102991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-377fc5ca-14d9-4dcd-b85a-6797d1cc6e10 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:39.566273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0e3729ca-2a78-4300-8ce0-a3e935b89032 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:39.575726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0e3729ca-2a78-4300-8ce0-a3e935b89032 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.641943 Jun 20 06:11:39.576625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 51/82] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:38 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:39.869316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-377fc5ca-14d9-4dcd-b85a-6797d1cc6e10 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:39.880155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-377fc5ca-14d9-4dcd-b85a-6797d1cc6e10 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.843493 Jun 20 06:11:39.886721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 32/83] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:39 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:40.051534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e13e3c29-7452-4967-8778-db7603461503 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:40.052944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e13e3c29-7452-4967-8778-db7603461503 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:40.076237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e13e3c29-7452-4967-8778-db7603461503 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.076978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e13e3c29-7452-4967-8778-db7603461503 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.078710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e13e3c29-7452-4967-8778-db7603461503 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.079418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e13e3c29-7452-4967-8778-db7603461503 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.361777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-5deb9ab9-4133-4b6c-bd46-a8bb938ee9ca req-46e0ca53-0bc6-47a8-9b14-06694900a21e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b369f9fb-8948-4eaf-994c-8b63e2198df3", "tag": "9d37c204-45f0-4ee3-81f7-0926b5433cec"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:40.384111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-5deb9ab9-4133-4b6c-bd46-a8bb938ee9ca req-46e0ca53-0bc6-47a8-9b14-06694900a21e service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.384842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-5deb9ab9-4133-4b6c-bd46-a8bb938ee9ca req-46e0ca53-0bc6-47a8-9b14-06694900a21e service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.432481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-5deb9ab9-4133-4b6c-bd46-a8bb938ee9ca req-46e0ca53-0bc6-47a8-9b14-06694900a21e service nova] Creating event network-changed:9d37c204-45f0-4ee3-81f7-0926b5433cec for instance b369f9fb-8948-4eaf-994c-8b63e2198df3 on hv-cinder-80473 Jun 20 06:11:40.433264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-5deb9ab9-4133-4b6c-bd46-a8bb938ee9ca req-46e0ca53-0bc6-47a8-9b14-06694900a21e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 06:11:40.434726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89cd3a99-e3e6-4864-84a9-e68f1bf30165 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.435468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89cd3a99-e3e6-4864-84a9-e68f1bf30165 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.436663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89cd3a99-e3e6-4864-84a9-e68f1bf30165 None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.437778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89cd3a99-e3e6-4864-84a9-e68f1bf30165 None None] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.450297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.compute.rpcapi [None req-89cd3a99-e3e6-4864-84a9-e68f1bf30165 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 06:11:40.451590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89cd3a99-e3e6-4864-84a9-e68f1bf30165 None None] Releasing lock "compute-rpcapi-router" {{(pid=117727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 06:11:40.485866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89cd3a99-e3e6-4864-84a9-e68f1bf30165 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127999 Jun 20 06:11:40.487375 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 33/84] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:40.595108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-207906f0-ad0d-4370-a12d-08f37dc8c0ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:40.597077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-207906f0-ad0d-4370-a12d-08f37dc8c0ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:40.616445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-207906f0-ad0d-4370-a12d-08f37dc8c0ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.617598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-207906f0-ad0d-4370-a12d-08f37dc8c0ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.618419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-207906f0-ad0d-4370-a12d-08f37dc8c0ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.621889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-207906f0-ad0d-4370-a12d-08f37dc8c0ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.673287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e13e3c29-7452-4967-8778-db7603461503 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:40.683010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e13e3c29-7452-4967-8778-db7603461503 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.635217 Jun 20 06:11:40.684198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 52/85] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:40 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:40.912689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bcb65323-0e49-4109-85bd-22f3b6f9d1aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:40.917050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bcb65323-0e49-4109-85bd-22f3b6f9d1aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:40.921403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-207906f0-ad0d-4370-a12d-08f37dc8c0ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:40.928145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bcb65323-0e49-4109-85bd-22f3b6f9d1aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.928602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bcb65323-0e49-4109-85bd-22f3b6f9d1aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.933125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bcb65323-0e49-4109-85bd-22f3b6f9d1aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.933618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bcb65323-0e49-4109-85bd-22f3b6f9d1aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:40.936011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-207906f0-ad0d-4370-a12d-08f37dc8c0ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.346519 Jun 20 06:11:40.936608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 34/86] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:40 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:40.978941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-3597ec60-fcd8-4195-b462-c79382d7c6e7 req-77c359d3-c691-4803-ae7e-3b0ba82cf70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d", "tag": "478aa840-55c2-4787-a84e-c8aa250b5fb0"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:40.989615 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-3597ec60-fcd8-4195-b462-c79382d7c6e7 req-77c359d3-c691-4803-ae7e-3b0ba82cf70d service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:40.990409 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-3597ec60-fcd8-4195-b462-c79382d7c6e7 req-77c359d3-c691-4803-ae7e-3b0ba82cf70d service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:41.003089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-3597ec60-fcd8-4195-b462-c79382d7c6e7 req-77c359d3-c691-4803-ae7e-3b0ba82cf70d service nova] Creating event network-changed:478aa840-55c2-4787-a84e-c8aa250b5fb0 for instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d on hv-cinder-80473 Jun 20 06:11:41.008193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-3597ec60-fcd8-4195-b462-c79382d7c6e7 req-77c359d3-c691-4803-ae7e-3b0ba82cf70d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033800 Jun 20 06:11:41.010195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 35/87] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:41.412574 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bcb65323-0e49-4109-85bd-22f3b6f9d1aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:41.424567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bcb65323-0e49-4109-85bd-22f3b6f9d1aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.520416 Jun 20 06:11:41.429430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 53/88] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:40 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:41.701730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-34302125-2ec2-40e5-95dc-8920cbd509dd tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:41.703018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-34302125-2ec2-40e5-95dc-8920cbd509dd tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:41.714103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34302125-2ec2-40e5-95dc-8920cbd509dd tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:41.714753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34302125-2ec2-40e5-95dc-8920cbd509dd tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:41.716457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34302125-2ec2-40e5-95dc-8920cbd509dd tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:41.717051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34302125-2ec2-40e5-95dc-8920cbd509dd tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:41.743134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:41.937344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-34302125-2ec2-40e5-95dc-8920cbd509dd tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:41.945326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-34302125-2ec2-40e5-95dc-8920cbd509dd tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.248119 Jun 20 06:11:41.945975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 36/89] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:41 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:41.960130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4225d633-a362-41ee-aa1c-99d923d78e9a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:41.960745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4225d633-a362-41ee-aa1c-99d923d78e9a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:41.968454 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4225d633-a362-41ee-aa1c-99d923d78e9a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:41.968906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4225d633-a362-41ee-aa1c-99d923d78e9a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:41.969812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4225d633-a362-41ee-aa1c-99d923d78e9a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:41.970228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4225d633-a362-41ee-aa1c-99d923d78e9a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:41.974581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:42.212117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4225d633-a362-41ee-aa1c-99d923d78e9a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:42.220417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4225d633-a362-41ee-aa1c-99d923d78e9a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.264003 Jun 20 06:11:42.220980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 54/90] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:41 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:42.444015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-487bc91e-75d7-4da6-a6c1-fae1bc21eafa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:42.444673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-487bc91e-75d7-4da6-a6c1-fae1bc21eafa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:42.451332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487bc91e-75d7-4da6-a6c1-fae1bc21eafa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.451781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487bc91e-75d7-4da6-a6c1-fae1bc21eafa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.452566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487bc91e-75d7-4da6-a6c1-fae1bc21eafa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.452991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487bc91e-75d7-4da6-a6c1-fae1bc21eafa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.960753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-487bc91e-75d7-4da6-a6c1-fae1bc21eafa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:42.966334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-94248eed-42a5-475b-84c4-bd0ae7f4a21f tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:42.966967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-94248eed-42a5-475b-84c4-bd0ae7f4a21f tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:42.973627 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94248eed-42a5-475b-84c4-bd0ae7f4a21f tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.974127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94248eed-42a5-475b-84c4-bd0ae7f4a21f tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.974904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94248eed-42a5-475b-84c4-bd0ae7f4a21f tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.975331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94248eed-42a5-475b-84c4-bd0ae7f4a21f tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.975807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-487bc91e-75d7-4da6-a6c1-fae1bc21eafa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.535615 Jun 20 06:11:42.981627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 37/91] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:42 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:43.241346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-09f0a50b-e236-46fa-867b-321a0d8482f1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:43.242070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-09f0a50b-e236-46fa-867b-321a0d8482f1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:43.249366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09f0a50b-e236-46fa-867b-321a0d8482f1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.249843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09f0a50b-e236-46fa-867b-321a0d8482f1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.250792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09f0a50b-e236-46fa-867b-321a0d8482f1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.251237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09f0a50b-e236-46fa-867b-321a0d8482f1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.367506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-94248eed-42a5-475b-84c4-bd0ae7f4a21f tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.376237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-94248eed-42a5-475b-84c4-bd0ae7f4a21f tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.416371 Jun 20 06:11:43.387503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 55/92] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:42 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:43.448998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-09f0a50b-e236-46fa-867b-321a0d8482f1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.464753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-09f0a50b-e236-46fa-867b-321a0d8482f1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.228401 Jun 20 06:11:43.465500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 38/93] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:43 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:43.994504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7cdd6fc2-e0ca-4885-8de3-46b2ab970a6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:43.995871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7cdd6fc2-e0ca-4885-8de3-46b2ab970a6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:44.002334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cdd6fc2-e0ca-4885-8de3-46b2ab970a6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.002783 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cdd6fc2-e0ca-4885-8de3-46b2ab970a6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.003571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cdd6fc2-e0ca-4885-8de3-46b2ab970a6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.004152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cdd6fc2-e0ca-4885-8de3-46b2ab970a6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.192292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7cdd6fc2-e0ca-4885-8de3-46b2ab970a6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.201971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7cdd6fc2-e0ca-4885-8de3-46b2ab970a6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.212483 Jun 20 06:11:44.213540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 56/94] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:43 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:44.394998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-72d6bc60-b926-4599-9289-4a6d2bf57b8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:44.396740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-72d6bc60-b926-4599-9289-4a6d2bf57b8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:44.403461 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72d6bc60-b926-4599-9289-4a6d2bf57b8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.404303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72d6bc60-b926-4599-9289-4a6d2bf57b8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.405205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72d6bc60-b926-4599-9289-4a6d2bf57b8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.405809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72d6bc60-b926-4599-9289-4a6d2bf57b8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.486955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7729fa7d-901a-48fa-ad85-051711f5269b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:44.487702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7729fa7d-901a-48fa-ad85-051711f5269b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:44.507505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7729fa7d-901a-48fa-ad85-051711f5269b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.507505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7729fa7d-901a-48fa-ad85-051711f5269b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.507505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7729fa7d-901a-48fa-ad85-051711f5269b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.507505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7729fa7d-901a-48fa-ad85-051711f5269b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.638309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-72d6bc60-b926-4599-9289-4a6d2bf57b8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.653477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-72d6bc60-b926-4599-9289-4a6d2bf57b8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.262804 Jun 20 06:11:44.654093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 39/95] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:44 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:44.910303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7729fa7d-901a-48fa-ad85-051711f5269b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.919592 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7729fa7d-901a-48fa-ad85-051711f5269b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.436670 Jun 20 06:11:44.920928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 57/96] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:44 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:45.219500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-96605461-7cfb-487e-9f59-9363e01a1055 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.220212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-96605461-7cfb-487e-9f59-9363e01a1055 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.226443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96605461-7cfb-487e-9f59-9363e01a1055 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.226992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96605461-7cfb-487e-9f59-9363e01a1055 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.227994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96605461-7cfb-487e-9f59-9363e01a1055 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.228726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96605461-7cfb-487e-9f59-9363e01a1055 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.405203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-96605461-7cfb-487e-9f59-9363e01a1055 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:45.413190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-96605461-7cfb-487e-9f59-9363e01a1055 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.197969 Jun 20 06:11:45.414486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 40/97] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:45.671680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fcbc8a6a-befe-46cf-9744-c18c25d95485 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.672132 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fcbc8a6a-befe-46cf-9744-c18c25d95485 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.675174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:45.682946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcbc8a6a-befe-46cf-9744-c18c25d95485 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.686417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcbc8a6a-befe-46cf-9744-c18c25d95485 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.690531 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcbc8a6a-befe-46cf-9744-c18c25d95485 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.691359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcbc8a6a-befe-46cf-9744-c18c25d95485 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.855577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fcbc8a6a-befe-46cf-9744-c18c25d95485 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:45.863734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fcbc8a6a-befe-46cf-9744-c18c25d95485 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.196046 Jun 20 06:11:45.866762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 58/98] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:45.936295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d4c91b75-6edf-4698-9e13-4e181f7ec927 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.936907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d4c91b75-6edf-4698-9e13-4e181f7ec927 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.943134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4c91b75-6edf-4698-9e13-4e181f7ec927 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.943829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4c91b75-6edf-4698-9e13-4e181f7ec927 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.944874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4c91b75-6edf-4698-9e13-4e181f7ec927 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.945530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4c91b75-6edf-4698-9e13-4e181f7ec927 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.102535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d4c91b75-6edf-4698-9e13-4e181f7ec927 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.111924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d4c91b75-6edf-4698-9e13-4e181f7ec927 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.179474 Jun 20 06:11:46.112963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 41/99] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:46.430515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e11c7d5f-61f0-4185-9534-d27d2ab39e7e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:46.431161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e11c7d5f-61f0-4185-9534-d27d2ab39e7e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:46.437595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e11c7d5f-61f0-4185-9534-d27d2ab39e7e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.438262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e11c7d5f-61f0-4185-9534-d27d2ab39e7e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.439336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e11c7d5f-61f0-4185-9534-d27d2ab39e7e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.439923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e11c7d5f-61f0-4185-9534-d27d2ab39e7e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.587626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e11c7d5f-61f0-4185-9534-d27d2ab39e7e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.595502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e11c7d5f-61f0-4185-9534-d27d2ab39e7e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.168698 Jun 20 06:11:46.604949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 59/100] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:46 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:46.881345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b190ae68-8a15-4fa4-ad8f-9bc3f2503d35 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:46.882108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b190ae68-8a15-4fa4-ad8f-9bc3f2503d35 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:46.885551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:46.890820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b190ae68-8a15-4fa4-ad8f-9bc3f2503d35 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.891366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b190ae68-8a15-4fa4-ad8f-9bc3f2503d35 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.892352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b190ae68-8a15-4fa4-ad8f-9bc3f2503d35 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.893055 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b190ae68-8a15-4fa4-ad8f-9bc3f2503d35 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.053309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b190ae68-8a15-4fa4-ad8f-9bc3f2503d35 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.061959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b190ae68-8a15-4fa4-ad8f-9bc3f2503d35 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.184283 Jun 20 06:11:47.072698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 42/101] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:46 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:47.130764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3c2d800f-79da-4a1f-b03d-4885bae6d61e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:47.131500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3c2d800f-79da-4a1f-b03d-4885bae6d61e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:47.138930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c2d800f-79da-4a1f-b03d-4885bae6d61e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.139381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c2d800f-79da-4a1f-b03d-4885bae6d61e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.140145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c2d800f-79da-4a1f-b03d-4885bae6d61e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.140578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c2d800f-79da-4a1f-b03d-4885bae6d61e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.309470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3c2d800f-79da-4a1f-b03d-4885bae6d61e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.319637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3c2d800f-79da-4a1f-b03d-4885bae6d61e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.192462 Jun 20 06:11:47.320343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 60/102] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:47 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:47.612154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0c8b4eeb-15a9-43ed-9672-288f3c916db1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:47.612764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0c8b4eeb-15a9-43ed-9672-288f3c916db1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:47.619278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c8b4eeb-15a9-43ed-9672-288f3c916db1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.619908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c8b4eeb-15a9-43ed-9672-288f3c916db1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.620977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c8b4eeb-15a9-43ed-9672-288f3c916db1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.621709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c8b4eeb-15a9-43ed-9672-288f3c916db1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.803037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0c8b4eeb-15a9-43ed-9672-288f3c916db1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.814812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0c8b4eeb-15a9-43ed-9672-288f3c916db1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.206209 Jun 20 06:11:47.817840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 43/103] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:47 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:48.080446 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a470575d-8960-443c-a322-9d3815eb62bc tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.080982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a470575d-8960-443c-a322-9d3815eb62bc tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.087135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a470575d-8960-443c-a322-9d3815eb62bc tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.088371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a470575d-8960-443c-a322-9d3815eb62bc tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.089291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a470575d-8960-443c-a322-9d3815eb62bc tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.089762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a470575d-8960-443c-a322-9d3815eb62bc tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.221813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:48.239572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a470575d-8960-443c-a322-9d3815eb62bc tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.248982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a470575d-8960-443c-a322-9d3815eb62bc tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.172825 Jun 20 06:11:48.249577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 61/104] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:48.337861 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89c6b2ce-00d0-48d0-95da-05d16cbdb443 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.339354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-89c6b2ce-00d0-48d0-95da-05d16cbdb443 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.346458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89c6b2ce-00d0-48d0-95da-05d16cbdb443 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.347179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89c6b2ce-00d0-48d0-95da-05d16cbdb443 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.348145 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89c6b2ce-00d0-48d0-95da-05d16cbdb443 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.349005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89c6b2ce-00d0-48d0-95da-05d16cbdb443 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.518048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-89c6b2ce-00d0-48d0-95da-05d16cbdb443 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.529527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89c6b2ce-00d0-48d0-95da-05d16cbdb443 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.195761 Jun 20 06:11:48.530452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 44/105] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:48.832514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-925278c8-d183-4cc2-a99c-12d18ff3a955 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.833234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-925278c8-d183-4cc2-a99c-12d18ff3a955 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.845063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-925278c8-d183-4cc2-a99c-12d18ff3a955 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.845539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-925278c8-d183-4cc2-a99c-12d18ff3a955 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.846731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-925278c8-d183-4cc2-a99c-12d18ff3a955 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.847329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-925278c8-d183-4cc2-a99c-12d18ff3a955 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.004268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-925278c8-d183-4cc2-a99c-12d18ff3a955 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.022514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-925278c8-d183-4cc2-a99c-12d18ff3a955 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.194093 Jun 20 06:11:49.024902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 62/106] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:49.266078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a1d78470-64e7-49af-9595-895e2b4aeb61 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:49.266845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a1d78470-64e7-49af-9595-895e2b4aeb61 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:49.275330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1d78470-64e7-49af-9595-895e2b4aeb61 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.280052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1d78470-64e7-49af-9595-895e2b4aeb61 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.281022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1d78470-64e7-49af-9595-895e2b4aeb61 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.281603 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1d78470-64e7-49af-9595-895e2b4aeb61 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.547714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-61401f68-1f43-484c-a8bc-f29965e90abe tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:49.548379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-61401f68-1f43-484c-a8bc-f29965e90abe tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:49.558417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a1d78470-64e7-49af-9595-895e2b4aeb61 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.558889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61401f68-1f43-484c-a8bc-f29965e90abe tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.559326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61401f68-1f43-484c-a8bc-f29965e90abe tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.560127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61401f68-1f43-484c-a8bc-f29965e90abe tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.560747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61401f68-1f43-484c-a8bc-f29965e90abe tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.574757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a1d78470-64e7-49af-9595-895e2b4aeb61 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.309894 Jun 20 06:11:49.575395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 45/107] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:49 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:49.745946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-61401f68-1f43-484c-a8bc-f29965e90abe tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.754293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-61401f68-1f43-484c-a8bc-f29965e90abe tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.210967 Jun 20 06:11:49.755595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 63/108] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:49 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:50.041208 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3540e684-e53e-4b79-945c-85a662f9cbf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.041861 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3540e684-e53e-4b79-945c-85a662f9cbf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.048780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3540e684-e53e-4b79-945c-85a662f9cbf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.049226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3540e684-e53e-4b79-945c-85a662f9cbf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.050215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3540e684-e53e-4b79-945c-85a662f9cbf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.050802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3540e684-e53e-4b79-945c-85a662f9cbf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.204057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3540e684-e53e-4b79-945c-85a662f9cbf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.215344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3540e684-e53e-4b79-945c-85a662f9cbf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.179218 Jun 20 06:11:50.215926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 46/109] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:50 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:50.592118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f405e67-ea83-459f-9b6f-cb4898b6d8bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.592769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f405e67-ea83-459f-9b6f-cb4898b6d8bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.598743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f405e67-ea83-459f-9b6f-cb4898b6d8bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.599257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f405e67-ea83-459f-9b6f-cb4898b6d8bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.600014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f405e67-ea83-459f-9b6f-cb4898b6d8bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.600440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f405e67-ea83-459f-9b6f-cb4898b6d8bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.747002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7f405e67-ea83-459f-9b6f-cb4898b6d8bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.754444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f405e67-ea83-459f-9b6f-cb4898b6d8bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.166280 Jun 20 06:11:50.755058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 64/110] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:50 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:50.772074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee703583-4d01-4d2b-ad25-a6f9bb0a1def tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.772681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee703583-4d01-4d2b-ad25-a6f9bb0a1def tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.774610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:50.779988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee703583-4d01-4d2b-ad25-a6f9bb0a1def tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.780455 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee703583-4d01-4d2b-ad25-a6f9bb0a1def tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.781235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee703583-4d01-4d2b-ad25-a6f9bb0a1def tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.781686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee703583-4d01-4d2b-ad25-a6f9bb0a1def tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.922919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ee703583-4d01-4d2b-ad25-a6f9bb0a1def tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.933013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee703583-4d01-4d2b-ad25-a6f9bb0a1def tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.164843 Jun 20 06:11:50.933731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 47/111] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:50 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:51.233523 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b6ed1e48-6995-46e0-8dea-7b4700958a80 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.234179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b6ed1e48-6995-46e0-8dea-7b4700958a80 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.240110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b6ed1e48-6995-46e0-8dea-7b4700958a80 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.240552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b6ed1e48-6995-46e0-8dea-7b4700958a80 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.241304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b6ed1e48-6995-46e0-8dea-7b4700958a80 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.241757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b6ed1e48-6995-46e0-8dea-7b4700958a80 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.393639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b6ed1e48-6995-46e0-8dea-7b4700958a80 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:51.402021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b6ed1e48-6995-46e0-8dea-7b4700958a80 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.173693 Jun 20 06:11:51.402595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 65/112] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:51.771642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9be7f23f-65ca-45dd-b569-3f145fbea844 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.772248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9be7f23f-65ca-45dd-b569-3f145fbea844 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.778290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9be7f23f-65ca-45dd-b569-3f145fbea844 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.778745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9be7f23f-65ca-45dd-b569-3f145fbea844 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.779504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9be7f23f-65ca-45dd-b569-3f145fbea844 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.779939 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9be7f23f-65ca-45dd-b569-3f145fbea844 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.918255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9be7f23f-65ca-45dd-b569-3f145fbea844 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:51.925831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9be7f23f-65ca-45dd-b569-3f145fbea844 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.158307 Jun 20 06:11:51.926467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 48/113] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:51.950573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9eab039d-f0e5-4a2c-b71c-d39c1ce19879 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.951217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9eab039d-f0e5-4a2c-b71c-d39c1ce19879 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.958112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9eab039d-f0e5-4a2c-b71c-d39c1ce19879 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.958478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9eab039d-f0e5-4a2c-b71c-d39c1ce19879 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.959239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9eab039d-f0e5-4a2c-b71c-d39c1ce19879 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.959668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9eab039d-f0e5-4a2c-b71c-d39c1ce19879 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.097060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9eab039d-f0e5-4a2c-b71c-d39c1ce19879 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.105719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9eab039d-f0e5-4a2c-b71c-d39c1ce19879 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.159857 Jun 20 06:11:52.106361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 66/114] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:52.419329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c1909c80-a712-40bd-b82b-2f741847566f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:52.420097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c1909c80-a712-40bd-b82b-2f741847566f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:52.426134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1909c80-a712-40bd-b82b-2f741847566f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.426785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1909c80-a712-40bd-b82b-2f741847566f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.427608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1909c80-a712-40bd-b82b-2f741847566f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.428108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1909c80-a712-40bd-b82b-2f741847566f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.561747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c1909c80-a712-40bd-b82b-2f741847566f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.570022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c1909c80-a712-40bd-b82b-2f741847566f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.155298 Jun 20 06:11:52.570584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 49/115] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:52 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:52.942463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e68bd5c5-90c8-4aa4-8044-4b6693ae2d8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:52.943079 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e68bd5c5-90c8-4aa4-8044-4b6693ae2d8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:52.949814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e68bd5c5-90c8-4aa4-8044-4b6693ae2d8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.950207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e68bd5c5-90c8-4aa4-8044-4b6693ae2d8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.950967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e68bd5c5-90c8-4aa4-8044-4b6693ae2d8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.951497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e68bd5c5-90c8-4aa4-8044-4b6693ae2d8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.079560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e68bd5c5-90c8-4aa4-8044-4b6693ae2d8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.086992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e68bd5c5-90c8-4aa4-8044-4b6693ae2d8d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.148340 Jun 20 06:11:53.087868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 67/116] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:52 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:53.123348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-beed2838-48e1-49f6-b7c5-ee7321a22f8a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.124057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-beed2838-48e1-49f6-b7c5-ee7321a22f8a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:53.135201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-beed2838-48e1-49f6-b7c5-ee7321a22f8a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.136034 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-beed2838-48e1-49f6-b7c5-ee7321a22f8a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.137167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-beed2838-48e1-49f6-b7c5-ee7321a22f8a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.137636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-beed2838-48e1-49f6-b7c5-ee7321a22f8a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.268515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-beed2838-48e1-49f6-b7c5-ee7321a22f8a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.276337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-beed2838-48e1-49f6-b7c5-ee7321a22f8a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.157843 Jun 20 06:11:53.276894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 50/117] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:53 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:53.586897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-98263010-0bcf-461f-8095-f9f58b956f9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.587561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-98263010-0bcf-461f-8095-f9f58b956f9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:53.593602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-98263010-0bcf-461f-8095-f9f58b956f9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.594049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-98263010-0bcf-461f-8095-f9f58b956f9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.594801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-98263010-0bcf-461f-8095-f9f58b956f9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.595235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-98263010-0bcf-461f-8095-f9f58b956f9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.726654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-98263010-0bcf-461f-8095-f9f58b956f9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.735048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-98263010-0bcf-461f-8095-f9f58b956f9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.152042 Jun 20 06:11:53.735624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 68/118] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:53 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:54.104611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a14541ca-c105-43d2-aa79-e356b9018ec3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.105214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a14541ca-c105-43d2-aa79-e356b9018ec3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.111834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a14541ca-c105-43d2-aa79-e356b9018ec3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.112394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a14541ca-c105-43d2-aa79-e356b9018ec3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.113316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a14541ca-c105-43d2-aa79-e356b9018ec3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.113773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a14541ca-c105-43d2-aa79-e356b9018ec3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.257308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a14541ca-c105-43d2-aa79-e356b9018ec3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.265204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a14541ca-c105-43d2-aa79-e356b9018ec3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.164828 Jun 20 06:11:54.265793 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 51/119] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:54.292037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5b7663b6-a9a8-4d52-8d2e-44eb6a21549e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.292643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5b7663b6-a9a8-4d52-8d2e-44eb6a21549e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.298640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5b7663b6-a9a8-4d52-8d2e-44eb6a21549e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.299081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5b7663b6-a9a8-4d52-8d2e-44eb6a21549e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.299827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5b7663b6-a9a8-4d52-8d2e-44eb6a21549e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.300253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5b7663b6-a9a8-4d52-8d2e-44eb6a21549e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.434252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5b7663b6-a9a8-4d52-8d2e-44eb6a21549e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.442374 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5b7663b6-a9a8-4d52-8d2e-44eb6a21549e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.154233 Jun 20 06:11:54.442999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 69/120] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:54.752237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2fdc7852-5ab6-4881-ba5a-9c7d09a11780 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.752840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2fdc7852-5ab6-4881-ba5a-9c7d09a11780 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.759416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fdc7852-5ab6-4881-ba5a-9c7d09a11780 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.759984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fdc7852-5ab6-4881-ba5a-9c7d09a11780 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.760839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fdc7852-5ab6-4881-ba5a-9c7d09a11780 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.761276 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fdc7852-5ab6-4881-ba5a-9c7d09a11780 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.897573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2fdc7852-5ab6-4881-ba5a-9c7d09a11780 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.905403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-d436dfb4-9d01-4440-b574-0c2d5da20032 req-e8364050-fbf7-4025-8cdd-ad7cd833f0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d", "name": "network-vif-plugged", "status": "completed", "tag": "478aa840-55c2-4787-a84e-c8aa250b5fb0"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:54.905544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2fdc7852-5ab6-4881-ba5a-9c7d09a11780 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.157198 Jun 20 06:11:54.906181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 52/121] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:54.913327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-d436dfb4-9d01-4440-b574-0c2d5da20032 req-e8364050-fbf7-4025-8cdd-ad7cd833f0e1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.913800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-d436dfb4-9d01-4440-b574-0c2d5da20032 req-e8364050-fbf7-4025-8cdd-ad7cd833f0e1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.926024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-d436dfb4-9d01-4440-b574-0c2d5da20032 req-e8364050-fbf7-4025-8cdd-ad7cd833f0e1 service nova] Creating event network-vif-plugged:478aa840-55c2-4787-a84e-c8aa250b5fb0 for instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d on hv-cinder-80473 Jun 20 06:11:54.931914 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-d436dfb4-9d01-4440-b574-0c2d5da20032 req-e8364050-fbf7-4025-8cdd-ad7cd833f0e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090463 Jun 20 06:11:54.932496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 70/122] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:55.286393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-67a65ba2-d00b-4530-9916-22dc6c23ecc4 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.289062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-67a65ba2-d00b-4530-9916-22dc6c23ecc4 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.299254 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67a65ba2-d00b-4530-9916-22dc6c23ecc4 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.300039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67a65ba2-d00b-4530-9916-22dc6c23ecc4 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.300934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67a65ba2-d00b-4530-9916-22dc6c23ecc4 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.301502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67a65ba2-d00b-4530-9916-22dc6c23ecc4 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.307408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:55.454459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-67a65ba2-d00b-4530-9916-22dc6c23ecc4 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.463806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-535fe752-5586-4e70-b5c0-6beb9661cd58 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.464677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-535fe752-5586-4e70-b5c0-6beb9661cd58 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.466937 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-67a65ba2-d00b-4530-9916-22dc6c23ecc4 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.188331 Jun 20 06:11:55.476771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 53/123] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:55.477317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-535fe752-5586-4e70-b5c0-6beb9661cd58 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.477317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-535fe752-5586-4e70-b5c0-6beb9661cd58 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.477317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-535fe752-5586-4e70-b5c0-6beb9661cd58 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.477317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-535fe752-5586-4e70-b5c0-6beb9661cd58 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.509846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:55.664801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-535fe752-5586-4e70-b5c0-6beb9661cd58 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.673453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-535fe752-5586-4e70-b5c0-6beb9661cd58 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.215109 Jun 20 06:11:55.683832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 71/124] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:55.922284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6bacb9d5-495a-4e4f-9d3d-660b8f625189 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.922817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6bacb9d5-495a-4e4f-9d3d-660b8f625189 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.928973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bacb9d5-495a-4e4f-9d3d-660b8f625189 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.929452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bacb9d5-495a-4e4f-9d3d-660b8f625189 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.930464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bacb9d5-495a-4e4f-9d3d-660b8f625189 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.931072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bacb9d5-495a-4e4f-9d3d-660b8f625189 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.082167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6bacb9d5-495a-4e4f-9d3d-660b8f625189 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.091755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6bacb9d5-495a-4e4f-9d3d-660b8f625189 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.173282 Jun 20 06:11:56.092340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 54/125] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:56.484024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8cb911a1-dc09-48ff-9cc6-8734230275d5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.484944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8cb911a1-dc09-48ff-9cc6-8734230275d5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.491643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cb911a1-dc09-48ff-9cc6-8734230275d5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.492425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cb911a1-dc09-48ff-9cc6-8734230275d5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.494051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cb911a1-dc09-48ff-9cc6-8734230275d5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.494593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cb911a1-dc09-48ff-9cc6-8734230275d5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.646537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8cb911a1-dc09-48ff-9cc6-8734230275d5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.654530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8cb911a1-dc09-48ff-9cc6-8734230275d5 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.174767 Jun 20 06:11:56.655166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 72/126] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:56.693480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c50922ad-c3ff-4727-95cb-b9e4fcdcbcc8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.694091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c50922ad-c3ff-4727-95cb-b9e4fcdcbcc8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.701218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c50922ad-c3ff-4727-95cb-b9e4fcdcbcc8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.701769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c50922ad-c3ff-4727-95cb-b9e4fcdcbcc8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.702559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c50922ad-c3ff-4727-95cb-b9e4fcdcbcc8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.702964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c50922ad-c3ff-4727-95cb-b9e4fcdcbcc8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.856790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c50922ad-c3ff-4727-95cb-b9e4fcdcbcc8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.875438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c50922ad-c3ff-4727-95cb-b9e4fcdcbcc8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.187337 Jun 20 06:11:56.875605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 55/127] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:57.108781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-47c0de48-0167-410c-b654-f7f501d8845c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:57.109300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-47c0de48-0167-410c-b654-f7f501d8845c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.115252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47c0de48-0167-410c-b654-f7f501d8845c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.115694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47c0de48-0167-410c-b654-f7f501d8845c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.116441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47c0de48-0167-410c-b654-f7f501d8845c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.116871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47c0de48-0167-410c-b654-f7f501d8845c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.255917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-47c0de48-0167-410c-b654-f7f501d8845c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.263914 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-47c0de48-0167-410c-b654-f7f501d8845c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.158845 Jun 20 06:11:57.264791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 73/128] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:57 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:57.672511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b3e7df73-6de0-485e-9b70-a5594219a809 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:57.673112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b3e7df73-6de0-485e-9b70-a5594219a809 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.680016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3e7df73-6de0-485e-9b70-a5594219a809 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.680537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3e7df73-6de0-485e-9b70-a5594219a809 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.681659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3e7df73-6de0-485e-9b70-a5594219a809 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.682099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3e7df73-6de0-485e-9b70-a5594219a809 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.836408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b3e7df73-6de0-485e-9b70-a5594219a809 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.845645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b3e7df73-6de0-485e-9b70-a5594219a809 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.177479 Jun 20 06:11:57.846439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 56/129] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:57 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:57.892700 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-63a259be-9704-483b-867a-2c1e6c3d1a18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:57.893541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-63a259be-9704-483b-867a-2c1e6c3d1a18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.902576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63a259be-9704-483b-867a-2c1e6c3d1a18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.904482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63a259be-9704-483b-867a-2c1e6c3d1a18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.905367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63a259be-9704-483b-867a-2c1e6c3d1a18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.905822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63a259be-9704-483b-867a-2c1e6c3d1a18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.083821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-63a259be-9704-483b-867a-2c1e6c3d1a18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.093977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-63a259be-9704-483b-867a-2c1e6c3d1a18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.204826 Jun 20 06:11:58.094849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 74/130] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:57 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:58.282269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1fdfe7b2-9c58-4111-ac95-63ebc3c7a827 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.283200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1fdfe7b2-9c58-4111-ac95-63ebc3c7a827 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:58.295667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fdfe7b2-9c58-4111-ac95-63ebc3c7a827 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.296187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fdfe7b2-9c58-4111-ac95-63ebc3c7a827 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.297171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fdfe7b2-9c58-4111-ac95-63ebc3c7a827 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.297792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fdfe7b2-9c58-4111-ac95-63ebc3c7a827 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.506000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1fdfe7b2-9c58-4111-ac95-63ebc3c7a827 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.521324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1fdfe7b2-9c58-4111-ac95-63ebc3c7a827 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.242759 Jun 20 06:11:58.522506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 57/131] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:58.785625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-f39e3eb0-557e-4da9-9346-fdd438da5860 req-c99e6893-5a3c-40bb-9927-f6773dbeafe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b369f9fb-8948-4eaf-994c-8b63e2198df3", "name": "network-vif-plugged", "status": "completed", "tag": "9d37c204-45f0-4ee3-81f7-0926b5433cec"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:58.808660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f39e3eb0-557e-4da9-9346-fdd438da5860 req-c99e6893-5a3c-40bb-9927-f6773dbeafe4 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.810263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f39e3eb0-557e-4da9-9346-fdd438da5860 req-c99e6893-5a3c-40bb-9927-f6773dbeafe4 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.836217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-f39e3eb0-557e-4da9-9346-fdd438da5860 req-c99e6893-5a3c-40bb-9927-f6773dbeafe4 service nova] Creating event network-vif-plugged:9d37c204-45f0-4ee3-81f7-0926b5433cec for instance b369f9fb-8948-4eaf-994c-8b63e2198df3 on hv-cinder-80473 Jun 20 06:11:58.846458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-f39e3eb0-557e-4da9-9346-fdd438da5860 req-c99e6893-5a3c-40bb-9927-f6773dbeafe4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073189 Jun 20 06:11:58.858846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 75/132] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:58.869304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a4de0bb8-2a5d-4d6e-b48f-8642ee1f8dba tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.871538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a4de0bb8-2a5d-4d6e-b48f-8642ee1f8dba tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:58.881529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4de0bb8-2a5d-4d6e-b48f-8642ee1f8dba tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.882365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4de0bb8-2a5d-4d6e-b48f-8642ee1f8dba tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.883368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4de0bb8-2a5d-4d6e-b48f-8642ee1f8dba tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.884857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4de0bb8-2a5d-4d6e-b48f-8642ee1f8dba tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.068717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a4de0bb8-2a5d-4d6e-b48f-8642ee1f8dba tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:59.078195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a4de0bb8-2a5d-4d6e-b48f-8642ee1f8dba tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.216887 Jun 20 06:11:59.088526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 58/133] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:59.113002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc4d7072-c9d1-4953-8855-49b0ef501cc7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:59.113564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc4d7072-c9d1-4953-8855-49b0ef501cc7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:59.120158 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc4d7072-c9d1-4953-8855-49b0ef501cc7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.120569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc4d7072-c9d1-4953-8855-49b0ef501cc7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.121330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc4d7072-c9d1-4953-8855-49b0ef501cc7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.121857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc4d7072-c9d1-4953-8855-49b0ef501cc7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.286673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc4d7072-c9d1-4953-8855-49b0ef501cc7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:59.294603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc4d7072-c9d1-4953-8855-49b0ef501cc7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.186450 Jun 20 06:11:59.295178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 76/134] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:59 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:59.543363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d973cd73-a6de-4205-9886-37b3e8c9c1b2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:59.544085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d973cd73-a6de-4205-9886-37b3e8c9c1b2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:59.551646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d973cd73-a6de-4205-9886-37b3e8c9c1b2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.552174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d973cd73-a6de-4205-9886-37b3e8c9c1b2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.553014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d973cd73-a6de-4205-9886-37b3e8c9c1b2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.553477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d973cd73-a6de-4205-9886-37b3e8c9c1b2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.713522 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d973cd73-a6de-4205-9886-37b3e8c9c1b2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:59.720798 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d973cd73-a6de-4205-9886-37b3e8c9c1b2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.183775 Jun 20 06:11:59.721359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 59/135] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:59 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:00.099735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9655a6ef-0b48-48f8-9dc3-65eeb33494ff tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:00.101115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9655a6ef-0b48-48f8-9dc3-65eeb33494ff tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:00.115393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9655a6ef-0b48-48f8-9dc3-65eeb33494ff tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.121638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9655a6ef-0b48-48f8-9dc3-65eeb33494ff tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.122873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9655a6ef-0b48-48f8-9dc3-65eeb33494ff tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.123465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9655a6ef-0b48-48f8-9dc3-65eeb33494ff tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.332639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-41016a06-512b-451e-bb17-48134eb3c9ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:00.334372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-41016a06-512b-451e-bb17-48134eb3c9ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:00.353867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41016a06-512b-451e-bb17-48134eb3c9ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.356560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41016a06-512b-451e-bb17-48134eb3c9ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.357653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41016a06-512b-451e-bb17-48134eb3c9ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.359362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41016a06-512b-451e-bb17-48134eb3c9ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.670962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9655a6ef-0b48-48f8-9dc3-65eeb33494ff tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:00.680831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9655a6ef-0b48-48f8-9dc3-65eeb33494ff tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.588386 Jun 20 06:12:00.681448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 77/136] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:00 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:00.740426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-83e44b0e-b67d-4c7e-994a-a5f493dcf581 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:00.740426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-83e44b0e-b67d-4c7e-994a-a5f493dcf581 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:00.749256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83e44b0e-b67d-4c7e-994a-a5f493dcf581 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.759595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83e44b0e-b67d-4c7e-994a-a5f493dcf581 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.760601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83e44b0e-b67d-4c7e-994a-a5f493dcf581 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.761128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83e44b0e-b67d-4c7e-994a-a5f493dcf581 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.875340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-41016a06-512b-451e-bb17-48134eb3c9ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:00.883058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-41016a06-512b-451e-bb17-48134eb3c9ad tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.574401 Jun 20 06:12:00.886822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 60/137] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:00 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:00.898987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-dbb2c4b4-4949-43b7-b891-3c1a5a50760a req-a6ab9c8e-c691-4189-ba0a-18fed1771223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aba062d-1d92-4ba5-9b14-c68ed8a468db", "name": "network-vif-plugged", "status": "completed", "tag": "70e2fd66-d29c-4794-8f34-64715e0b1b55"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:00.912893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-dbb2c4b4-4949-43b7-b891-3c1a5a50760a req-a6ab9c8e-c691-4189-ba0a-18fed1771223 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.917758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-dbb2c4b4-4949-43b7-b891-3c1a5a50760a req-a6ab9c8e-c691-4189-ba0a-18fed1771223 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.951828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-dbb2c4b4-4949-43b7-b891-3c1a5a50760a req-a6ab9c8e-c691-4189-ba0a-18fed1771223 service nova] Creating event network-vif-plugged:70e2fd66-d29c-4794-8f34-64715e0b1b55 for instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db on hv-cinder-80473 Jun 20 06:12:00.957458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-dbb2c4b4-4949-43b7-b891-3c1a5a50760a req-a6ab9c8e-c691-4189-ba0a-18fed1771223 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069376 Jun 20 06:12:00.958428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 61/138] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:01.128510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-83e44b0e-b67d-4c7e-994a-a5f493dcf581 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.138909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-83e44b0e-b67d-4c7e-994a-a5f493dcf581 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.403887 Jun 20 06:12:01.150581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 78/139] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:00 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:01.698795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0aeb2c9c-7712-4ea9-a769-5141e3f1463b tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.699689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0aeb2c9c-7712-4ea9-a769-5141e3f1463b tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.707349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0aeb2c9c-7712-4ea9-a769-5141e3f1463b tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.707823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0aeb2c9c-7712-4ea9-a769-5141e3f1463b tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.708600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0aeb2c9c-7712-4ea9-a769-5141e3f1463b tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.709032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0aeb2c9c-7712-4ea9-a769-5141e3f1463b tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.875120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0aeb2c9c-7712-4ea9-a769-5141e3f1463b tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.883505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0aeb2c9c-7712-4ea9-a769-5141e3f1463b tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.188988 Jun 20 06:12:01.883883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 62/140] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:01.902950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45a35521-48e1-472d-8eb8-d1a58530c398 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.903839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-45a35521-48e1-472d-8eb8-d1a58530c398 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.910340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45a35521-48e1-472d-8eb8-d1a58530c398 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.910970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45a35521-48e1-472d-8eb8-d1a58530c398 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.911899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45a35521-48e1-472d-8eb8-d1a58530c398 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.912498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45a35521-48e1-472d-8eb8-d1a58530c398 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.073573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-45a35521-48e1-472d-8eb8-d1a58530c398 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.081329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-45a35521-48e1-472d-8eb8-d1a58530c398 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.182612 Jun 20 06:12:02.081959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 79/141] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:02.158469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-298205db-8320-4684-bcca-9cf3f7fa0ac8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.159360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-298205db-8320-4684-bcca-9cf3f7fa0ac8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.167051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-298205db-8320-4684-bcca-9cf3f7fa0ac8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.167512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-298205db-8320-4684-bcca-9cf3f7fa0ac8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.168968 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-298205db-8320-4684-bcca-9cf3f7fa0ac8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.169437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-298205db-8320-4684-bcca-9cf3f7fa0ac8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.331460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-298205db-8320-4684-bcca-9cf3f7fa0ac8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.345909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-298205db-8320-4684-bcca-9cf3f7fa0ac8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.192865 Jun 20 06:12:02.355751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 63/142] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:02.910246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-89e871f0-7a42-4346-9a56-9ed4bcdbb562 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.910246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-89e871f0-7a42-4346-9a56-9ed4bcdbb562 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.910246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89e871f0-7a42-4346-9a56-9ed4bcdbb562 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.911766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89e871f0-7a42-4346-9a56-9ed4bcdbb562 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.913735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89e871f0-7a42-4346-9a56-9ed4bcdbb562 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.915405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89e871f0-7a42-4346-9a56-9ed4bcdbb562 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.099601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-59274be7-272e-458c-b3c6-3d9073fd57db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:03.100212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-59274be7-272e-458c-b3c6-3d9073fd57db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:03.106831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59274be7-272e-458c-b3c6-3d9073fd57db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.107291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59274be7-272e-458c-b3c6-3d9073fd57db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.108068 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59274be7-272e-458c-b3c6-3d9073fd57db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.108497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59274be7-272e-458c-b3c6-3d9073fd57db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.188085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-89e871f0-7a42-4346-9a56-9ed4bcdbb562 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:03.198092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-89e871f0-7a42-4346-9a56-9ed4bcdbb562 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.300934 Jun 20 06:12:03.199387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 80/143] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:03.364820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c53993cb-6289-4c16-916c-adc045ea16ab tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:03.365504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c53993cb-6289-4c16-916c-adc045ea16ab tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:03.390551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c53993cb-6289-4c16-916c-adc045ea16ab tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.398190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c53993cb-6289-4c16-916c-adc045ea16ab tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.402268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c53993cb-6289-4c16-916c-adc045ea16ab tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.402953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-59274be7-272e-458c-b3c6-3d9073fd57db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:03.405370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c53993cb-6289-4c16-916c-adc045ea16ab tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.410960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-59274be7-272e-458c-b3c6-3d9073fd57db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.315052 Jun 20 06:12:03.418708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 64/144] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:03 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:03.718836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c53993cb-6289-4c16-916c-adc045ea16ab tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:03.727672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c53993cb-6289-4c16-916c-adc045ea16ab tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1322 microversion: 2.1 time: 0.367931 Jun 20 06:12:03.728604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 81/145] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:03 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:04.218454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24dc5cc3-ed2e-40a9-877e-9565d3ac558c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:04.218906 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24dc5cc3-ed2e-40a9-877e-9565d3ac558c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.226811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24dc5cc3-ed2e-40a9-877e-9565d3ac558c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.228535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24dc5cc3-ed2e-40a9-877e-9565d3ac558c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.230301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24dc5cc3-ed2e-40a9-877e-9565d3ac558c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.231176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24dc5cc3-ed2e-40a9-877e-9565d3ac558c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.412101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24dc5cc3-ed2e-40a9-877e-9565d3ac558c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.420996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24dc5cc3-ed2e-40a9-877e-9565d3ac558c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.209361 Jun 20 06:12:04.422456 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 65/146] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:04 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:04.428871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-17b77b51-da9e-481d-8d85-1bfd634f4cb3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:04.430738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-17b77b51-da9e-481d-8d85-1bfd634f4cb3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.457136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17b77b51-da9e-481d-8d85-1bfd634f4cb3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.459037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17b77b51-da9e-481d-8d85-1bfd634f4cb3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.460737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17b77b51-da9e-481d-8d85-1bfd634f4cb3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.461519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17b77b51-da9e-481d-8d85-1bfd634f4cb3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.643620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-17b77b51-da9e-481d-8d85-1bfd634f4cb3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.651770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-17b77b51-da9e-481d-8d85-1bfd634f4cb3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.227286 Jun 20 06:12:04.652582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 82/147] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:04 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:04.747184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f2366ce4-5967-4360-a018-0cc74ab32b7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:04.747944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f2366ce4-5967-4360-a018-0cc74ab32b7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.757601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2366ce4-5967-4360-a018-0cc74ab32b7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.758700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2366ce4-5967-4360-a018-0cc74ab32b7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.759807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2366ce4-5967-4360-a018-0cc74ab32b7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.760399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2366ce4-5967-4360-a018-0cc74ab32b7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.933019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f2366ce4-5967-4360-a018-0cc74ab32b7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.942688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f2366ce4-5967-4360-a018-0cc74ab32b7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1517 microversion: 2.1 time: 0.202429 Jun 20 06:12:04.948774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 66/148] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:04 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:04.973716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-99557b31-77f1-4b0c-88bb-39e254a76793 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:04.975050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-99557b31-77f1-4b0c-88bb-39e254a76793 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.982416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99557b31-77f1-4b0c-88bb-39e254a76793 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.983129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99557b31-77f1-4b0c-88bb-39e254a76793 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.984801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99557b31-77f1-4b0c-88bb-39e254a76793 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.985468 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99557b31-77f1-4b0c-88bb-39e254a76793 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.063446 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-99557b31-77f1-4b0c-88bb-39e254a76793 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lazy-loading 'flavor' on Instance uuid b369f9fb-8948-4eaf-994c-8b63e2198df3 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:12:05.197659 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-99557b31-77f1-4b0c-88bb-39e254a76793 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3/action" status: 200 len: 32 microversion: 2.1 time: 0.228700 Jun 20 06:12:05.198291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 83/149] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:12:04 2022] POST /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:12:05.207824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fbd1bee6-80f2-42f6-8a2b-e9c5975e2d81 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.208513 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fbd1bee6-80f2-42f6-8a2b-e9c5975e2d81 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.214726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbd1bee6-80f2-42f6-8a2b-e9c5975e2d81 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.215181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbd1bee6-80f2-42f6-8a2b-e9c5975e2d81 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.215955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbd1bee6-80f2-42f6-8a2b-e9c5975e2d81 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.216390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbd1bee6-80f2-42f6-8a2b-e9c5975e2d81 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.363277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fbd1bee6-80f2-42f6-8a2b-e9c5975e2d81 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:05.372331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fbd1bee6-80f2-42f6-8a2b-e9c5975e2d81 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.168946 Jun 20 06:12:05.372902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 67/150] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:05.440111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fbb715d8-3264-45cd-a6b3-5b03e43e1006 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.441243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fbb715d8-3264-45cd-a6b3-5b03e43e1006 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.450998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fbb715d8-3264-45cd-a6b3-5b03e43e1006 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.451613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fbb715d8-3264-45cd-a6b3-5b03e43e1006 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.452742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fbb715d8-3264-45cd-a6b3-5b03e43e1006 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.453281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fbb715d8-3264-45cd-a6b3-5b03e43e1006 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.669537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-abea02e8-ee21-4028-9803-0b0e5a0028f7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.670410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-abea02e8-ee21-4028-9803-0b0e5a0028f7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.682642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fbb715d8-3264-45cd-a6b3-5b03e43e1006 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:05.690182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fbb715d8-3264-45cd-a6b3-5b03e43e1006 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.255110 Jun 20 06:12:05.690695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 84/151] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:05.695185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abea02e8-ee21-4028-9803-0b0e5a0028f7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.695628 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abea02e8-ee21-4028-9803-0b0e5a0028f7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.697060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abea02e8-ee21-4028-9803-0b0e5a0028f7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.697526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abea02e8-ee21-4028-9803-0b0e5a0028f7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.877795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-abea02e8-ee21-4028-9803-0b0e5a0028f7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:05.891828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-abea02e8-ee21-4028-9803-0b0e5a0028f7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.225839 Jun 20 06:12:05.904059 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 68/152] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:06.389645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-437604ff-d51d-4bc7-b1e2-863d7a2b4e4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:06.390935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-437604ff-d51d-4bc7-b1e2-863d7a2b4e4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:06.398443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-437604ff-d51d-4bc7-b1e2-863d7a2b4e4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.399782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-437604ff-d51d-4bc7-b1e2-863d7a2b4e4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.400814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-437604ff-d51d-4bc7-b1e2-863d7a2b4e4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.401251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-437604ff-d51d-4bc7-b1e2-863d7a2b4e4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.560923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-437604ff-d51d-4bc7-b1e2-863d7a2b4e4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.571302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-437604ff-d51d-4bc7-b1e2-863d7a2b4e4b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.185426 Jun 20 06:12:06.572909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 85/153] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:06 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:06.707734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fd51e023-ec66-453a-be8a-d82867acd931 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:06.708809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fd51e023-ec66-453a-be8a-d82867acd931 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:06.728305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd51e023-ec66-453a-be8a-d82867acd931 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.728838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd51e023-ec66-453a-be8a-d82867acd931 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.733095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd51e023-ec66-453a-be8a-d82867acd931 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.733771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd51e023-ec66-453a-be8a-d82867acd931 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.911022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-84d14f0e-b161-4f8f-a700-10d6f068e4bf tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:06.911666 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-84d14f0e-b161-4f8f-a700-10d6f068e4bf tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:06.919084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84d14f0e-b161-4f8f-a700-10d6f068e4bf tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.920050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84d14f0e-b161-4f8f-a700-10d6f068e4bf tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.921335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84d14f0e-b161-4f8f-a700-10d6f068e4bf tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.921954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84d14f0e-b161-4f8f-a700-10d6f068e4bf tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.964900 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fd51e023-ec66-453a-be8a-d82867acd931 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.974565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fd51e023-ec66-453a-be8a-d82867acd931 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.270583 Jun 20 06:12:06.975876 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 69/154] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:06 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:07.101760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-84d14f0e-b161-4f8f-a700-10d6f068e4bf tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:07.109841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:07.113013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-84d14f0e-b161-4f8f-a700-10d6f068e4bf tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.205670 Jun 20 06:12:07.123225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 86/155] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:06 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:07.589766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-22200b47-239e-4e78-b308-f2641c971144 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.590506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-22200b47-239e-4e78-b308-f2641c971144 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:07.598133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-22200b47-239e-4e78-b308-f2641c971144 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.598835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-22200b47-239e-4e78-b308-f2641c971144 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.600115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-22200b47-239e-4e78-b308-f2641c971144 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.601269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-22200b47-239e-4e78-b308-f2641c971144 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.641476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:07.822172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-22200b47-239e-4e78-b308-f2641c971144 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:07.832534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-22200b47-239e-4e78-b308-f2641c971144 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.248455 Jun 20 06:12:07.833339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 70/156] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:07.996750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-72e4fde1-74cc-4d72-b0d2-28e74aa4a9bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.998811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-72e4fde1-74cc-4d72-b0d2-28e74aa4a9bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:08.016928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72e4fde1-74cc-4d72-b0d2-28e74aa4a9bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.017733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72e4fde1-74cc-4d72-b0d2-28e74aa4a9bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.019331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72e4fde1-74cc-4d72-b0d2-28e74aa4a9bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.019958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72e4fde1-74cc-4d72-b0d2-28e74aa4a9bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.130124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5a36af79-28c6-421c-a53d-ebf4f4288e25 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:08.130802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5a36af79-28c6-421c-a53d-ebf4f4288e25 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:08.145927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a36af79-28c6-421c-a53d-ebf4f4288e25 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.150745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a36af79-28c6-421c-a53d-ebf4f4288e25 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.153269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a36af79-28c6-421c-a53d-ebf4f4288e25 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.157556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a36af79-28c6-421c-a53d-ebf4f4288e25 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.370240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-72e4fde1-74cc-4d72-b0d2-28e74aa4a9bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.380444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-72e4fde1-74cc-4d72-b0d2-28e74aa4a9bb tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1315 microversion: 2.1 time: 0.388930 Jun 20 06:12:08.388212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 87/157] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:08.393802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-6ab2b6d5-9631-4bae-aad4-691610f1b002 req-24cfa896-662f-4f09-b399-17bf51a830ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7697c07f-5fd2-4b76-87af-0cb70746a73e", "name": "network-vif-plugged", "status": "completed", "tag": "6ace4e19-63bf-4af0-8997-ab7c43711b52"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:08.403574 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-6ab2b6d5-9631-4bae-aad4-691610f1b002 req-24cfa896-662f-4f09-b399-17bf51a830ee service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.404029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-6ab2b6d5-9631-4bae-aad4-691610f1b002 req-24cfa896-662f-4f09-b399-17bf51a830ee service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.419592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5a36af79-28c6-421c-a53d-ebf4f4288e25 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.423225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-6ab2b6d5-9631-4bae-aad4-691610f1b002 req-24cfa896-662f-4f09-b399-17bf51a830ee service nova] Creating event network-vif-plugged:6ace4e19-63bf-4af0-8997-ab7c43711b52 for instance 7697c07f-5fd2-4b76-87af-0cb70746a73e on hv-cinder-80473 Jun 20 06:12:08.427860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5a36af79-28c6-421c-a53d-ebf4f4288e25 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.302136 Jun 20 06:12:08.428439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 71/158] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:08 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:08.439928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-6ab2b6d5-9631-4bae-aad4-691610f1b002 req-24cfa896-662f-4f09-b399-17bf51a830ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050358 Jun 20 06:12:08.440736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 88/159] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:08.850902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-018f3725-f9b4-4bcf-8e73-e0c0f0ccced8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:08.851521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-018f3725-f9b4-4bcf-8e73-e0c0f0ccced8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:08.861137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-018f3725-f9b4-4bcf-8e73-e0c0f0ccced8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.861811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-018f3725-f9b4-4bcf-8e73-e0c0f0ccced8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.862665 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-018f3725-f9b4-4bcf-8e73-e0c0f0ccced8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.863689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-018f3725-f9b4-4bcf-8e73-e0c0f0ccced8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.142534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-018f3725-f9b4-4bcf-8e73-e0c0f0ccced8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.156798 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-018f3725-f9b4-4bcf-8e73-e0c0f0ccced8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.310103 Jun 20 06:12:09.169820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 72/160] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:08 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:09.396385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-761c9c11-fac5-4dab-bcce-0be5fece3bd3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.397792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-761c9c11-fac5-4dab-bcce-0be5fece3bd3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.405725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-761c9c11-fac5-4dab-bcce-0be5fece3bd3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.406344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-761c9c11-fac5-4dab-bcce-0be5fece3bd3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.407305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-761c9c11-fac5-4dab-bcce-0be5fece3bd3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.407880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-761c9c11-fac5-4dab-bcce-0be5fece3bd3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.444176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9e86a79a-2a1a-4f1b-8ca5-74e4a1e1d4b0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.444932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9e86a79a-2a1a-4f1b-8ca5-74e4a1e1d4b0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.458546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e86a79a-2a1a-4f1b-8ca5-74e4a1e1d4b0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.458661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e86a79a-2a1a-4f1b-8ca5-74e4a1e1d4b0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.459720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e86a79a-2a1a-4f1b-8ca5-74e4a1e1d4b0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.460165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e86a79a-2a1a-4f1b-8ca5-74e4a1e1d4b0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.717139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-761c9c11-fac5-4dab-bcce-0be5fece3bd3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.725590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-761c9c11-fac5-4dab-bcce-0be5fece3bd3 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1502 microversion: 2.1 time: 0.333795 Jun 20 06:12:09.726343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 89/161] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:09.738512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9e86a79a-2a1a-4f1b-8ca5-74e4a1e1d4b0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.750320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9e86a79a-2a1a-4f1b-8ca5-74e4a1e1d4b0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.310035 Jun 20 06:12:09.761806 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 73/162] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:10.176153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8c390ccd-55f3-4457-976f-cbd320b911ac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:10.177187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8c390ccd-55f3-4457-976f-cbd320b911ac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:10.184368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c390ccd-55f3-4457-976f-cbd320b911ac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.184776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c390ccd-55f3-4457-976f-cbd320b911ac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.185569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c390ccd-55f3-4457-976f-cbd320b911ac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.186347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c390ccd-55f3-4457-976f-cbd320b911ac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.330810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8c390ccd-55f3-4457-976f-cbd320b911ac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:10.340972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8c390ccd-55f3-4457-976f-cbd320b911ac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.169495 Jun 20 06:12:10.341797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 90/163] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:10 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:10.767788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-30b81fab-c72b-49b7-bb17-f21cc1363cc6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:10.768397 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-30b81fab-c72b-49b7-bb17-f21cc1363cc6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:10.774721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30b81fab-c72b-49b7-bb17-f21cc1363cc6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.775168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30b81fab-c72b-49b7-bb17-f21cc1363cc6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.775922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30b81fab-c72b-49b7-bb17-f21cc1363cc6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.776407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30b81fab-c72b-49b7-bb17-f21cc1363cc6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.913986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-30b81fab-c72b-49b7-bb17-f21cc1363cc6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:10.923003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-30b81fab-c72b-49b7-bb17-f21cc1363cc6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.158866 Jun 20 06:12:10.923680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 74/164] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:10 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:11.360200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fcc96711-ac2b-4e87-906d-6e91d801fb6f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:11.361057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fcc96711-ac2b-4e87-906d-6e91d801fb6f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:11.367144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcc96711-ac2b-4e87-906d-6e91d801fb6f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.367675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcc96711-ac2b-4e87-906d-6e91d801fb6f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.368897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcc96711-ac2b-4e87-906d-6e91d801fb6f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.369337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcc96711-ac2b-4e87-906d-6e91d801fb6f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.501790 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fcc96711-ac2b-4e87-906d-6e91d801fb6f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:11.511177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fcc96711-ac2b-4e87-906d-6e91d801fb6f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.155474 Jun 20 06:12:11.512147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 91/165] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:11 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:11.940594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b2344592-15fb-4a48-aa76-a9a3cf8da920 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:11.941305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b2344592-15fb-4a48-aa76-a9a3cf8da920 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:11.948087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2344592-15fb-4a48-aa76-a9a3cf8da920 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.948604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2344592-15fb-4a48-aa76-a9a3cf8da920 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.949408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2344592-15fb-4a48-aa76-a9a3cf8da920 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.949845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2344592-15fb-4a48-aa76-a9a3cf8da920 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.090917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b2344592-15fb-4a48-aa76-a9a3cf8da920 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.098472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b2344592-15fb-4a48-aa76-a9a3cf8da920 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.161677 Jun 20 06:12:12.099144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 75/166] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:11 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:12.529903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0221ad12-5647-4084-ba0f-a82bc3f6b987 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:12.530498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0221ad12-5647-4084-ba0f-a82bc3f6b987 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:12.536323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0221ad12-5647-4084-ba0f-a82bc3f6b987 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.536813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0221ad12-5647-4084-ba0f-a82bc3f6b987 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.537549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0221ad12-5647-4084-ba0f-a82bc3f6b987 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.538140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0221ad12-5647-4084-ba0f-a82bc3f6b987 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.751594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0221ad12-5647-4084-ba0f-a82bc3f6b987 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.760778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0221ad12-5647-4084-ba0f-a82bc3f6b987 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.234648 Jun 20 06:12:12.761634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 92/167] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:12 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:13.116899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c02f9875-ee40-461c-8452-16a532a6a30f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:13.118081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c02f9875-ee40-461c-8452-16a532a6a30f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:13.124338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c02f9875-ee40-461c-8452-16a532a6a30f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.124787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c02f9875-ee40-461c-8452-16a532a6a30f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.125592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c02f9875-ee40-461c-8452-16a532a6a30f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.126029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c02f9875-ee40-461c-8452-16a532a6a30f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.261533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c02f9875-ee40-461c-8452-16a532a6a30f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:13.268855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c02f9875-ee40-461c-8452-16a532a6a30f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.156400 Jun 20 06:12:13.269464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 76/168] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:13 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:13.780207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2d8c00cd-e35b-4f1a-9ff1-372dbf1d6103 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:13.780822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2d8c00cd-e35b-4f1a-9ff1-372dbf1d6103 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:13.788065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d8c00cd-e35b-4f1a-9ff1-372dbf1d6103 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.788709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d8c00cd-e35b-4f1a-9ff1-372dbf1d6103 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.790120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d8c00cd-e35b-4f1a-9ff1-372dbf1d6103 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.790558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d8c00cd-e35b-4f1a-9ff1-372dbf1d6103 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.966068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2d8c00cd-e35b-4f1a-9ff1-372dbf1d6103 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:13.976421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2d8c00cd-e35b-4f1a-9ff1-372dbf1d6103 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.199946 Jun 20 06:12:13.977829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 93/169] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:13 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:14.267469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a8bf3ff3-2143-4429-b644-d6a4f8786a5c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a44ab0e-3705-420d-9591-ee5d5798ce58"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:14.268606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a8bf3ff3-2143-4429-b644-d6a4f8786a5c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:14.275076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8bf3ff3-2143-4429-b644-d6a4f8786a5c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.275523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8bf3ff3-2143-4429-b644-d6a4f8786a5c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.276294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8bf3ff3-2143-4429-b644-d6a4f8786a5c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.276724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8bf3ff3-2143-4429-b644-d6a4f8786a5c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.286258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-79a270a4-e239-4c84-9b60-d517e6185527 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.286943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-79a270a4-e239-4c84-9b60-d517e6185527 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:14.297737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79a270a4-e239-4c84-9b60-d517e6185527 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.298394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79a270a4-e239-4c84-9b60-d517e6185527 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.299781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79a270a4-e239-4c84-9b60-d517e6185527 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.300601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79a270a4-e239-4c84-9b60-d517e6185527 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.582097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-79a270a4-e239-4c84-9b60-d517e6185527 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:14.590379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-79a270a4-e239-4c84-9b60-d517e6185527 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1361 microversion: 2.1 time: 0.308215 Jun 20 06:12:14.591118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 94/170] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:14 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:14.702711 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a8bf3ff3-2143-4429-b644-d6a4f8786a5c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "POST /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439188 Jun 20 06:12:14.703343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 77/171] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:12:14 2022] POST /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:14.994287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-19dc5404-76ff-401b-ae9a-5c31292a4e07 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.994841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-19dc5404-76ff-401b-ae9a-5c31292a4e07 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:15.001072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19dc5404-76ff-401b-ae9a-5c31292a4e07 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.001570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19dc5404-76ff-401b-ae9a-5c31292a4e07 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.002344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19dc5404-76ff-401b-ae9a-5c31292a4e07 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.002783 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19dc5404-76ff-401b-ae9a-5c31292a4e07 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.383712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-19dc5404-76ff-401b-ae9a-5c31292a4e07 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:15.392145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-19dc5404-76ff-401b-ae9a-5c31292a4e07 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.402184 Jun 20 06:12:15.393076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 95/172] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:14 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:15.618666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e71a981c-c6e9-428e-9659-c5d3ec1cd05e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:15.619517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e71a981c-c6e9-428e-9659-c5d3ec1cd05e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:15.627744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e71a981c-c6e9-428e-9659-c5d3ec1cd05e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.628401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e71a981c-c6e9-428e-9659-c5d3ec1cd05e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.629161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e71a981c-c6e9-428e-9659-c5d3ec1cd05e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.629644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e71a981c-c6e9-428e-9659-c5d3ec1cd05e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.775936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e71a981c-c6e9-428e-9659-c5d3ec1cd05e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:15.783767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e71a981c-c6e9-428e-9659-c5d3ec1cd05e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1547 microversion: 2.1 time: 0.172719 Jun 20 06:12:15.784419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 78/173] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:15 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:15.800899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c24b8f4f-77c5-4d8c-95cc-8ed128d69d18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:15.801407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c24b8f4f-77c5-4d8c-95cc-8ed128d69d18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:15.803496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=76 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:15.808844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c24b8f4f-77c5-4d8c-95cc-8ed128d69d18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.809478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c24b8f4f-77c5-4d8c-95cc-8ed128d69d18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.810374 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c24b8f4f-77c5-4d8c-95cc-8ed128d69d18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.810809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c24b8f4f-77c5-4d8c-95cc-8ed128d69d18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.891733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c24b8f4f-77c5-4d8c-95cc-8ed128d69d18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095001 Jun 20 06:12:15.892343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 96/174] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jun 20 06:12:15 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:16.412681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a46343ce-6a6f-481a-b5bb-4922ae253c37 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:16.412681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a46343ce-6a6f-481a-b5bb-4922ae253c37 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:16.419031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a46343ce-6a6f-481a-b5bb-4922ae253c37 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.419491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a46343ce-6a6f-481a-b5bb-4922ae253c37 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.420259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a46343ce-6a6f-481a-b5bb-4922ae253c37 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.420773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a46343ce-6a6f-481a-b5bb-4922ae253c37 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.735276 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a46343ce-6a6f-481a-b5bb-4922ae253c37 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.747428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a46343ce-6a6f-481a-b5bb-4922ae253c37 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.340283 Jun 20 06:12:16.748457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 79/175] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:16 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:17.235056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-f3fae434-b112-4fd9-88de-9128c04ba54d req-ce04c914-a36c-48b4-9f03-a18558fe4123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7697c07f-5fd2-4b76-87af-0cb70746a73e", "tag": "6ace4e19-63bf-4af0-8997-ab7c43711b52"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:17.247034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f3fae434-b112-4fd9-88de-9128c04ba54d req-ce04c914-a36c-48b4-9f03-a18558fe4123 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.248113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f3fae434-b112-4fd9-88de-9128c04ba54d req-ce04c914-a36c-48b4-9f03-a18558fe4123 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.262336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-f3fae434-b112-4fd9-88de-9128c04ba54d req-ce04c914-a36c-48b4-9f03-a18558fe4123 service nova] Creating event network-changed:6ace4e19-63bf-4af0-8997-ab7c43711b52 for instance 7697c07f-5fd2-4b76-87af-0cb70746a73e on hv-cinder-80473 Jun 20 06:12:17.267713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-f3fae434-b112-4fd9-88de-9128c04ba54d req-ce04c914-a36c-48b4-9f03-a18558fe4123 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037135 Jun 20 06:12:17.268407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 97/176] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:17.765789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b079b3c6-3db6-4394-8538-ba2c2c0825e0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:17.767015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b079b3c6-3db6-4394-8538-ba2c2c0825e0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:17.771526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=76 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:17.787229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b079b3c6-3db6-4394-8538-ba2c2c0825e0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.787916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b079b3c6-3db6-4394-8538-ba2c2c0825e0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.788825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b079b3c6-3db6-4394-8538-ba2c2c0825e0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.790870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b079b3c6-3db6-4394-8538-ba2c2c0825e0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.019549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b079b3c6-3db6-4394-8538-ba2c2c0825e0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:18.032336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b079b3c6-3db6-4394-8538-ba2c2c0825e0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.269872 Jun 20 06:12:18.034419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 80/177] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:17 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:19.054284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f7be1148-7bd8-4046-a3e0-29d886c82d9c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:19.055584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f7be1148-7bd8-4046-a3e0-29d886c82d9c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:19.063823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f7be1148-7bd8-4046-a3e0-29d886c82d9c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.064492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f7be1148-7bd8-4046-a3e0-29d886c82d9c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.065481 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f7be1148-7bd8-4046-a3e0-29d886c82d9c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.065930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f7be1148-7bd8-4046-a3e0-29d886c82d9c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.386098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f7be1148-7bd8-4046-a3e0-29d886c82d9c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:19.393752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f7be1148-7bd8-4046-a3e0-29d886c82d9c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.346460 Jun 20 06:12:19.394314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 98/178] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:19 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:20.412320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dff5d380-5712-4146-a1e4-d2be41eedcf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:20.412966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dff5d380-5712-4146-a1e4-d2be41eedcf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:20.419791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dff5d380-5712-4146-a1e4-d2be41eedcf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.420241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dff5d380-5712-4146-a1e4-d2be41eedcf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.421015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dff5d380-5712-4146-a1e4-d2be41eedcf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.421733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dff5d380-5712-4146-a1e4-d2be41eedcf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.553724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dff5d380-5712-4146-a1e4-d2be41eedcf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:20.562196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dff5d380-5712-4146-a1e4-d2be41eedcf3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.153763 Jun 20 06:12:20.562752 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 81/179] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:20 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:21.580221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-87de5322-0a81-4511-afda-2f6399be2848 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:21.580832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-87de5322-0a81-4511-afda-2f6399be2848 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:21.587733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-87de5322-0a81-4511-afda-2f6399be2848 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.588179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-87de5322-0a81-4511-afda-2f6399be2848 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.588937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-87de5322-0a81-4511-afda-2f6399be2848 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.589372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-87de5322-0a81-4511-afda-2f6399be2848 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.735714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-87de5322-0a81-4511-afda-2f6399be2848 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.750354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-87de5322-0a81-4511-afda-2f6399be2848 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.173933 Jun 20 06:12:21.751324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 99/180] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:21 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:22.768590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-58c621cf-b2b5-44b8-8393-7c0263106506 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:22.769620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-58c621cf-b2b5-44b8-8393-7c0263106506 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:22.779337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58c621cf-b2b5-44b8-8393-7c0263106506 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.780528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58c621cf-b2b5-44b8-8393-7c0263106506 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.781346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58c621cf-b2b5-44b8-8393-7c0263106506 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.781809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58c621cf-b2b5-44b8-8393-7c0263106506 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.932528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-58c621cf-b2b5-44b8-8393-7c0263106506 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:22.941185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-58c621cf-b2b5-44b8-8393-7c0263106506 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.177123 Jun 20 06:12:22.941897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 82/181] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:22 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:23.958747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-87a20189-6545-48a4-bc8e-277c6248f7ed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:23.959353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-87a20189-6545-48a4-bc8e-277c6248f7ed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:23.965704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-87a20189-6545-48a4-bc8e-277c6248f7ed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.966153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-87a20189-6545-48a4-bc8e-277c6248f7ed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:23.967167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-87a20189-6545-48a4-bc8e-277c6248f7ed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.967850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-87a20189-6545-48a4-bc8e-277c6248f7ed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:24.110358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-87a20189-6545-48a4-bc8e-277c6248f7ed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:24.118758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-87a20189-6545-48a4-bc8e-277c6248f7ed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.163784 Jun 20 06:12:24.119389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 100/182] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:23 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:25.137697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d25e92d4-255d-4604-ae20-6b4a606b186b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:25.138305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d25e92d4-255d-4604-ae20-6b4a606b186b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:25.144716 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d25e92d4-255d-4604-ae20-6b4a606b186b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.145164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d25e92d4-255d-4604-ae20-6b4a606b186b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.146208 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d25e92d4-255d-4604-ae20-6b4a606b186b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.146636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d25e92d4-255d-4604-ae20-6b4a606b186b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.277210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d25e92d4-255d-4604-ae20-6b4a606b186b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:25.284584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d25e92d4-255d-4604-ae20-6b4a606b186b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.150818 Jun 20 06:12:25.285144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 83/183] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:25 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:26.301568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-700f06b3-f48b-4811-85b3-ef3765a1f76c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:26.302182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-700f06b3-f48b-4811-85b3-ef3765a1f76c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:26.311751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-700f06b3-f48b-4811-85b3-ef3765a1f76c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.312202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-700f06b3-f48b-4811-85b3-ef3765a1f76c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.312970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-700f06b3-f48b-4811-85b3-ef3765a1f76c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.313419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-700f06b3-f48b-4811-85b3-ef3765a1f76c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.446438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-700f06b3-f48b-4811-85b3-ef3765a1f76c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:26.453770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-700f06b3-f48b-4811-85b3-ef3765a1f76c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.156089 Jun 20 06:12:26.454340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 101/184] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:26 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:27.470488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-68610d03-9189-4591-8048-9e5ed9bd7f61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:27.471089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-68610d03-9189-4591-8048-9e5ed9bd7f61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:27.478577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68610d03-9189-4591-8048-9e5ed9bd7f61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.479021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68610d03-9189-4591-8048-9e5ed9bd7f61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.479780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68610d03-9189-4591-8048-9e5ed9bd7f61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.480216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68610d03-9189-4591-8048-9e5ed9bd7f61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.614627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-68610d03-9189-4591-8048-9e5ed9bd7f61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:27.622813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-68610d03-9189-4591-8048-9e5ed9bd7f61 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.156091 Jun 20 06:12:27.623381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 84/185] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:27 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:28.640072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dfb3ace4-a8a9-4596-a63f-c9f4d7a0476a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:28.640680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dfb3ace4-a8a9-4596-a63f-c9f4d7a0476a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:28.646884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfb3ace4-a8a9-4596-a63f-c9f4d7a0476a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:28.647327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfb3ace4-a8a9-4596-a63f-c9f4d7a0476a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:28.648079 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfb3ace4-a8a9-4596-a63f-c9f4d7a0476a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:28.649147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfb3ace4-a8a9-4596-a63f-c9f4d7a0476a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:28.787809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dfb3ace4-a8a9-4596-a63f-c9f4d7a0476a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:28.795220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dfb3ace4-a8a9-4596-a63f-c9f4d7a0476a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.158932 Jun 20 06:12:28.795773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 102/186] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:28 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:29.811957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fd177c6b-db98-4b50-aca9-43845e9ae374 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:29.813273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fd177c6b-db98-4b50-aca9-43845e9ae374 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:29.821070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd177c6b-db98-4b50-aca9-43845e9ae374 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.821596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd177c6b-db98-4b50-aca9-43845e9ae374 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.823227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd177c6b-db98-4b50-aca9-43845e9ae374 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.823680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd177c6b-db98-4b50-aca9-43845e9ae374 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.985787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fd177c6b-db98-4b50-aca9-43845e9ae374 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:29.991059 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:29.996808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fd177c6b-db98-4b50-aca9-43845e9ae374 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.188524 Jun 20 06:12:30.006681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 85/187] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:29 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:30.809862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-171fb759-6253-4b7a-932b-7675665e93d8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:30.810393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-171fb759-6253-4b7a-932b-7675665e93d8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:30.825554 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-171fb759-6253-4b7a-932b-7675665e93d8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.826124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-171fb759-6253-4b7a-932b-7675665e93d8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.826978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-171fb759-6253-4b7a-932b-7675665e93d8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.827415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-171fb759-6253-4b7a-932b-7675665e93d8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.858489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-171fb759-6253-4b7a-932b-7675665e93d8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:12:30.913936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:30.965131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-171fb759-6253-4b7a-932b-7675665e93d8 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 204 len: 0 microversion: 2.1 time: 0.159464 Jun 20 06:12:30.966395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 103/188] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:12:30 2022] DELETE /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:12:30.975487 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f38dbb34-cb5d-4afe-a707-ef7add02b74c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:30.976093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f38dbb34-cb5d-4afe-a707-ef7add02b74c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:30.985079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f38dbb34-cb5d-4afe-a707-ef7add02b74c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.985750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f38dbb34-cb5d-4afe-a707-ef7add02b74c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.987013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f38dbb34-cb5d-4afe-a707-ef7add02b74c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.987363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f38dbb34-cb5d-4afe-a707-ef7add02b74c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.015533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3486fdf7-c1be-4ccc-84ac-57e96c2bfb47 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:31.016345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3486fdf7-c1be-4ccc-84ac-57e96c2bfb47 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:31.023172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3486fdf7-c1be-4ccc-84ac-57e96c2bfb47 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.024439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3486fdf7-c1be-4ccc-84ac-57e96c2bfb47 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.025997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3486fdf7-c1be-4ccc-84ac-57e96c2bfb47 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.026526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3486fdf7-c1be-4ccc-84ac-57e96c2bfb47 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.266019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3486fdf7-c1be-4ccc-84ac-57e96c2bfb47 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:31.266201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f38dbb34-cb5d-4afe-a707-ef7add02b74c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:31.274815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3486fdf7-c1be-4ccc-84ac-57e96c2bfb47 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.263624 Jun 20 06:12:31.275720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 104/189] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:31 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:31.276406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f38dbb34-cb5d-4afe-a707-ef7add02b74c tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1554 microversion: 2.1 time: 0.305291 Jun 20 06:12:31.277272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 86/190] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:30 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:32.295732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24fe82f8-9e60-4f28-9026-749a09029e58 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:32.297090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-042eea52-d18d-4f76-992d-7afd7c033c8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:32.297553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24fe82f8-9e60-4f28-9026-749a09029e58 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:32.299457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-042eea52-d18d-4f76-992d-7afd7c033c8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:32.305327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24fe82f8-9e60-4f28-9026-749a09029e58 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.306195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24fe82f8-9e60-4f28-9026-749a09029e58 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.307250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24fe82f8-9e60-4f28-9026-749a09029e58 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.307952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24fe82f8-9e60-4f28-9026-749a09029e58 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.318805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-042eea52-d18d-4f76-992d-7afd7c033c8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.319668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-042eea52-d18d-4f76-992d-7afd7c033c8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.320953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-042eea52-d18d-4f76-992d-7afd7c033c8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.322106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-042eea52-d18d-4f76-992d-7afd7c033c8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.587080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24fe82f8-9e60-4f28-9026-749a09029e58 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:32.604217 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24fe82f8-9e60-4f28-9026-749a09029e58 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1554 microversion: 2.1 time: 0.314484 Jun 20 06:12:32.605539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 87/191] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:32 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1554 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:32.622142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-042eea52-d18d-4f76-992d-7afd7c033c8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:32.629350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-042eea52-d18d-4f76-992d-7afd7c033c8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.338850 Jun 20 06:12:32.629948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 105/192] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:32 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:33.625262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-58b79337-8a26-4f85-b33c-171cdb968d17 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:33.625967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-58b79337-8a26-4f85-b33c-171cdb968d17 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:33.637764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58b79337-8a26-4f85-b33c-171cdb968d17 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.638378 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58b79337-8a26-4f85-b33c-171cdb968d17 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.639162 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58b79337-8a26-4f85-b33c-171cdb968d17 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.642082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58b79337-8a26-4f85-b33c-171cdb968d17 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.647444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d2c2a199-05de-40d0-80fe-5f7699f915b6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:33.648889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d2c2a199-05de-40d0-80fe-5f7699f915b6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:33.670895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2c2a199-05de-40d0-80fe-5f7699f915b6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.671443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2c2a199-05de-40d0-80fe-5f7699f915b6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.672244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2c2a199-05de-40d0-80fe-5f7699f915b6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.672687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2c2a199-05de-40d0-80fe-5f7699f915b6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.103729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d2c2a199-05de-40d0-80fe-5f7699f915b6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:34.108552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-58b79337-8a26-4f85-b33c-171cdb968d17 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:34.113933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d2c2a199-05de-40d0-80fe-5f7699f915b6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.469988 Jun 20 06:12:34.116095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 106/193] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:33 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:34.116442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-58b79337-8a26-4f85-b33c-171cdb968d17 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1554 microversion: 2.1 time: 0.495024 Jun 20 06:12:34.117011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 88/194] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:33 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1554 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:34.551281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-df2b4d64-c969-4381-a8a2-f5d17f1562e0 req-baaa0d3f-c2f0-42cf-bc79-83e4f633a9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aba062d-1d92-4ba5-9b14-c68ed8a468db", "name": "network-vif-deleted", "tag": "70e2fd66-d29c-4794-8f34-64715e0b1b55"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:34.570907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-df2b4d64-c969-4381-a8a2-f5d17f1562e0 req-baaa0d3f-c2f0-42cf-bc79-83e4f633a9c9 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:34.579963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-df2b4d64-c969-4381-a8a2-f5d17f1562e0 req-baaa0d3f-c2f0-42cf-bc79-83e4f633a9c9 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.609039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-df2b4d64-c969-4381-a8a2-f5d17f1562e0 req-baaa0d3f-c2f0-42cf-bc79-83e4f633a9c9 service nova] Creating event network-vif-deleted:70e2fd66-d29c-4794-8f34-64715e0b1b55 for instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db on hv-cinder-80473 Jun 20 06:12:34.620686 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-df2b4d64-c969-4381-a8a2-f5d17f1562e0 req-baaa0d3f-c2f0-42cf-bc79-83e4f633a9c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074147 Jun 20 06:12:34.628471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 107/195] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:35.133997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:35.135090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2abca28b-4254-4059-87ac-f2c297a12b53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:35.135936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2abca28b-4254-4059-87ac-f2c297a12b53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:35.136365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:35.143680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2abca28b-4254-4059-87ac-f2c297a12b53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.144196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.144672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2abca28b-4254-4059-87ac-f2c297a12b53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.145026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.146164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.146281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2abca28b-4254-4059-87ac-f2c297a12b53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.146957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2abca28b-4254-4059-87ac-f2c297a12b53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.147695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.184702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.185144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.185846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lazy-loading 'fault' on Instance uuid 7aba062d-1d92-4ba5-9b14-c68ed8a468db {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:12:35.243359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a1d536a0f491dab3cf34a5b1e2d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0955a8e221d146fa90cea6bd42bddb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:35.255402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-15a5c6e7-25ad-4a7a-91d4-93dececd3d1d tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 200 len: 1351 microversion: 2.1 time: 0.125381 Jun 20 06:12:35.256864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 89/196] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:35 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:35.347030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2abca28b-4254-4059-87ac-f2c297a12b53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:35.355631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2abca28b-4254-4059-87ac-f2c297a12b53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.225553 Jun 20 06:12:35.356196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 108/197] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:35 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:36.276661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:36.277258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:36.283675 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.284125 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.284885 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.285322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.299070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] HTTP exception thrown: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Request method failure captured: Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db HTTP/1.1 Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA-H29pGEeUrroU09nOPMsseSyenOA24iMFIBjM3XpoUg1tbEmPnDIM_JhX8Ij7H95DTxPOodByDSGK_OymzrgLpdC65yc3x42Xtc3w6s41YPsCUl7xvrMBTaSDpgMufoZmhFSS97GhFqaQJyP8qUFmZbXWHARUWOFTyuhsNfxYsDHY Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 0955a8e221d146fa90cea6bd42bddb53 Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:12:36.304100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0955a8e221d146fa90cea6bd42bddb53"}]}] Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 0955a8e221d146fa90cea6bd42bddb53 Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-DeleteServersTestJSON-1319593657-project Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: c94a1d536a0f491dab3cf34a5b1e2d9b Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-DeleteServersTestJSON-1319593657-project Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.305631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '7aba062d-1d92-4ba5-9b14-c68ed8a468db'} Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:12:36.306596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.308104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.309471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Returning 404 to user: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:12:36.309471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fce3302d-b65d-4ca7-8c5e-9c7d623c6496 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 404 len: 111 microversion: 2.1 time: 0.033284 Jun 20 06:12:36.309471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 90/198] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:36 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:12:36.371761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58d30691-dd0d-43b6-8c25-0c7bb25628ef tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:36.372461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-58d30691-dd0d-43b6-8c25-0c7bb25628ef tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:36.378690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58d30691-dd0d-43b6-8c25-0c7bb25628ef tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.379521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58d30691-dd0d-43b6-8c25-0c7bb25628ef tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.380018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58d30691-dd0d-43b6-8c25-0c7bb25628ef tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.380465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58d30691-dd0d-43b6-8c25-0c7bb25628ef tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.412001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:36.412981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:36.420114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.420562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.421325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.421786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.434965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] HTTP exception thrown: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Request method failure captured: Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db/os-volume_attachments HTTP/1.1 Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA-H29pGEeUrroU09nOPMsseSyenOA24iMFIBjM3XpoUg1tbEmPnDIM_JhX8Ij7H95DTxPOodByDSGK_OymzrgLpdC65yc3x42Xtc3w6s41YPsCUl7xvrMBTaSDpgMufoZmhFSS97GhFqaQJyP8qUFmZbXWHARUWOFTyuhsNfxYsDHY Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 0955a8e221d146fa90cea6bd42bddb53 Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:12:36.437146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0955a8e221d146fa90cea6bd42bddb53"}]}] Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 0955a8e221d146fa90cea6bd42bddb53 Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-DeleteServersTestJSON-1319593657-project Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: c94a1d536a0f491dab3cf34a5b1e2d9b Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-DeleteServersTestJSON-1319593657-project Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.438318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '7aba062d-1d92-4ba5-9b14-c68ed8a468db'} Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:12:36.438969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:36.440044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:36.441141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Returning 404 to user: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:12:36.441141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d742141-8cc5-4ed3-be15-6184eb7f0428 tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030584 Jun 20 06:12:36.442364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 91/199] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:12:36 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:12:36.568173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-58d30691-dd0d-43b6-8c25-0c7bb25628ef tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:36.581816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-58d30691-dd0d-43b6-8c25-0c7bb25628ef tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.213439 Jun 20 06:12:36.583887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 109/200] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:36 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:37.599958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-472777a1-f0bf-4165-872f-e0bfb8c9ae36 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:37.600595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-472777a1-f0bf-4165-872f-e0bfb8c9ae36 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:37.608510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-472777a1-f0bf-4165-872f-e0bfb8c9ae36 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.609033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-472777a1-f0bf-4165-872f-e0bfb8c9ae36 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.609897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-472777a1-f0bf-4165-872f-e0bfb8c9ae36 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.610333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-472777a1-f0bf-4165-872f-e0bfb8c9ae36 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.745617 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-472777a1-f0bf-4165-872f-e0bfb8c9ae36 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:37.753183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-472777a1-f0bf-4165-872f-e0bfb8c9ae36 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.157063 Jun 20 06:12:37.753768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 92/201] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:37 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:38.770682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9300faef-717d-4d3e-b822-af561a9d70d4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:38.771830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9300faef-717d-4d3e-b822-af561a9d70d4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:38.779509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9300faef-717d-4d3e-b822-af561a9d70d4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.780078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9300faef-717d-4d3e-b822-af561a9d70d4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.781223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9300faef-717d-4d3e-b822-af561a9d70d4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.781828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9300faef-717d-4d3e-b822-af561a9d70d4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.925532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9300faef-717d-4d3e-b822-af561a9d70d4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:38.939972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9300faef-717d-4d3e-b822-af561a9d70d4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.173717 Jun 20 06:12:38.940559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 110/202] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:38 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:39.826475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:39.826943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:39.833305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.833784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.834553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.834976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.849066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] HTTP exception thrown: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Request method failure captured: Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db HTTP/1.1 Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA-H29pGEeUrroU09nOPMsseSyenOA24iMFIBjM3XpoUg1tbEmPnDIM_JhX8Ij7H95DTxPOodByDSGK_OymzrgLpdC65yc3x42Xtc3w6s41YPsCUl7xvrMBTaSDpgMufoZmhFSS97GhFqaQJyP8qUFmZbXWHARUWOFTyuhsNfxYsDHY Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 0955a8e221d146fa90cea6bd42bddb53 Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:12:39.850677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0955a8e221d146fa90cea6bd42bddb53"}]}] Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 0955a8e221d146fa90cea6bd42bddb53 Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-DeleteServersTestJSON-1319593657-project Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: c94a1d536a0f491dab3cf34a5b1e2d9b Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-DeleteServersTestJSON-1319593657-project Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.852078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '7aba062d-1d92-4ba5-9b14-c68ed8a468db'} Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:12:39.852980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.854472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.855910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Returning 404 to user: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:12:39.855910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d22fdeb7-5740-4cb5-b404-ce68200000ac tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 404 len: 111 microversion: 2.1 time: 0.029546 Jun 20 06:12:39.855910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 93/203] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:12:39 2022] DELETE /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:12:39.860960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:39.861616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] [instance: 7aba062d-1d92-4ba5-9b14-c68ed8a468db] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:39.867448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.867902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.868778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.869089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.882476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] HTTP exception thrown: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Request method failure captured: Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db HTTP/1.1 Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA-H29pGEeUrroU09nOPMsseSyenOA24iMFIBjM3XpoUg1tbEmPnDIM_JhX8Ij7H95DTxPOodByDSGK_OymzrgLpdC65yc3x42Xtc3w6s41YPsCUl7xvrMBTaSDpgMufoZmhFSS97GhFqaQJyP8qUFmZbXWHARUWOFTyuhsNfxYsDHY Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 0955a8e221d146fa90cea6bd42bddb53 Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:12:39.887582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0955a8e221d146fa90cea6bd42bddb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0955a8e221d146fa90cea6bd42bddb53"}]}] Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 0955a8e221d146fa90cea6bd42bddb53 Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-DeleteServersTestJSON-1319593657 Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-DeleteServersTestJSON-1319593657-project Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: c94a1d536a0f491dab3cf34a5b1e2d9b Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-DeleteServersTestJSON-1319593657-project Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.889075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '7aba062d-1d92-4ba5-9b14-c68ed8a468db'} Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:12:39.889870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. Jun 20 06:12:39.891201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:12:39.892371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] Returning 404 to user: Instance 7aba062d-1d92-4ba5-9b14-c68ed8a468db could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:12:39.892371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b892605d-d158-4a6d-9711-86f4bbc8773a tempest-DeleteServersTestJSON-1319593657 tempest-DeleteServersTestJSON-1319593657-project] 10.222.0.16 "GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db" status: 404 len: 111 microversion: 2.1 time: 0.031821 Jun 20 06:12:39.892371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 111/204] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:39 2022] GET /compute/v2.1/servers/7aba062d-1d92-4ba5-9b14-c68ed8a468db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:12:39.957938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a5f9b7d0-567c-42e1-aa10-f39c068112f7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:39.958453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a5f9b7d0-567c-42e1-aa10-f39c068112f7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:39.965241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5f9b7d0-567c-42e1-aa10-f39c068112f7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.965755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5f9b7d0-567c-42e1-aa10-f39c068112f7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.966572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5f9b7d0-567c-42e1-aa10-f39c068112f7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.967004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5f9b7d0-567c-42e1-aa10-f39c068112f7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:40.399330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a5f9b7d0-567c-42e1-aa10-f39c068112f7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:40.407329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a5f9b7d0-567c-42e1-aa10-f39c068112f7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.453349 Jun 20 06:12:40.407895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 94/205] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:39 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:41.426001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bc4ac3a9-60f4-4b09-b50e-786a7e89424f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:41.426543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bc4ac3a9-60f4-4b09-b50e-786a7e89424f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:41.434408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc4ac3a9-60f4-4b09-b50e-786a7e89424f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:41.435124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc4ac3a9-60f4-4b09-b50e-786a7e89424f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:41.435913 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc4ac3a9-60f4-4b09-b50e-786a7e89424f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:41.438059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc4ac3a9-60f4-4b09-b50e-786a7e89424f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:41.625465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bc4ac3a9-60f4-4b09-b50e-786a7e89424f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:41.633260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bc4ac3a9-60f4-4b09-b50e-786a7e89424f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.211164 Jun 20 06:12:41.634134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 112/206] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:41 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:42.650820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5bf7599d-0637-4e82-9393-4d0feb714e02 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:42.651535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5bf7599d-0637-4e82-9393-4d0feb714e02 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:42.658281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bf7599d-0637-4e82-9393-4d0feb714e02 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:42.658817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bf7599d-0637-4e82-9393-4d0feb714e02 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:42.659858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bf7599d-0637-4e82-9393-4d0feb714e02 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:42.660367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bf7599d-0637-4e82-9393-4d0feb714e02 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:42.935021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5bf7599d-0637-4e82-9393-4d0feb714e02 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:42.943959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5bf7599d-0637-4e82-9393-4d0feb714e02 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.297261 Jun 20 06:12:42.944787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 95/207] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:42 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:43.962478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e89367be-aa92-4afa-bb5d-d070b87419d7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:43.963086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e89367be-aa92-4afa-bb5d-d070b87419d7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:43.969109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e89367be-aa92-4afa-bb5d-d070b87419d7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:43.969792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e89367be-aa92-4afa-bb5d-d070b87419d7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:43.973060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e89367be-aa92-4afa-bb5d-d070b87419d7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:43.974558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e89367be-aa92-4afa-bb5d-d070b87419d7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:44.145879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e89367be-aa92-4afa-bb5d-d070b87419d7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:44.153636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e89367be-aa92-4afa-bb5d-d070b87419d7 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.195556 Jun 20 06:12:44.154198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 113/208] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:43 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:45.170671 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cdafc50e-13bb-47c9-8142-b2581dd9f406 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:45.171280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cdafc50e-13bb-47c9-8142-b2581dd9f406 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:45.178358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdafc50e-13bb-47c9-8142-b2581dd9f406 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:45.179220 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdafc50e-13bb-47c9-8142-b2581dd9f406 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:45.180452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdafc50e-13bb-47c9-8142-b2581dd9f406 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:45.181126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdafc50e-13bb-47c9-8142-b2581dd9f406 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:45.334494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cdafc50e-13bb-47c9-8142-b2581dd9f406 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:45.345772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cdafc50e-13bb-47c9-8142-b2581dd9f406 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.178010 Jun 20 06:12:45.346899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 96/209] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:45 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:46.363311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c7de2615-fbfa-4844-8997-85b5701116f8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:46.377033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c7de2615-fbfa-4844-8997-85b5701116f8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:46.388070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:46.389931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c7de2615-fbfa-4844-8997-85b5701116f8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.390373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c7de2615-fbfa-4844-8997-85b5701116f8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.397503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c7de2615-fbfa-4844-8997-85b5701116f8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.398148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c7de2615-fbfa-4844-8997-85b5701116f8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.574137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c7de2615-fbfa-4844-8997-85b5701116f8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:46.583414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c7de2615-fbfa-4844-8997-85b5701116f8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.223749 Jun 20 06:12:46.584120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 114/210] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:46 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:47.602921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2cab3c01-f267-4987-b9ec-f112a2c982d3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:47.603431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2cab3c01-f267-4987-b9ec-f112a2c982d3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:47.612141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2cab3c01-f267-4987-b9ec-f112a2c982d3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:47.612301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2cab3c01-f267-4987-b9ec-f112a2c982d3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:47.613921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2cab3c01-f267-4987-b9ec-f112a2c982d3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:47.614464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2cab3c01-f267-4987-b9ec-f112a2c982d3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:47.885353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2cab3c01-f267-4987-b9ec-f112a2c982d3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:47.892824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2cab3c01-f267-4987-b9ec-f112a2c982d3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.295479 Jun 20 06:12:47.904738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 97/211] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:47 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:48.916462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-959da185-16a1-4982-bdd7-e6eca3b60600 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:48.922940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-959da185-16a1-4982-bdd7-e6eca3b60600 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:48.932608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-959da185-16a1-4982-bdd7-e6eca3b60600 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:48.933049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-959da185-16a1-4982-bdd7-e6eca3b60600 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:48.934206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-959da185-16a1-4982-bdd7-e6eca3b60600 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:48.935116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-959da185-16a1-4982-bdd7-e6eca3b60600 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:49.201570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-959da185-16a1-4982-bdd7-e6eca3b60600 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:49.215045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-959da185-16a1-4982-bdd7-e6eca3b60600 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.306873 Jun 20 06:12:49.216006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 115/212] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:48 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:49.997565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6695287b-7304-482a-9aba-4708915cf13a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: .version_select at 0x7f7a7b12faf0>, body: {"keypair": {"name": "tempest-keypair-674793659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRNnP/Q0tPQtDp20ttiyhGmHHaMfkOqLGI990J9JW+gzzLXlPVKjdZbyWxIjWPViwW0/5s5WLh+FSFEk3+ol0A0ZD+tukmgZl+QVduKkoSxT0tBj7UE57ZG5CkfZiDZnw=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:50.008036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=38 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:50.020002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-6695287b-7304-482a-9aba-4708915cf13a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for project fde00bac11024d898d6d87b8d2abc29e. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:12:50.024372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-6695287b-7304-482a-9aba-4708915cf13a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for user ee7405c2b1504907ba919e2797e63754 and project fde00bac11024d898d6d87b8d2abc29e. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:12:50.068534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6695287b-7304-482a-9aba-4708915cf13a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201275 Jun 20 06:12:50.078742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 98/213] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:12:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:50.233358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d86ed1e3-a8f1-4f36-801c-61217df4dbbf tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:50.234570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d86ed1e3-a8f1-4f36-801c-61217df4dbbf tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:50.246773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d86ed1e3-a8f1-4f36-801c-61217df4dbbf tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:50.247551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d86ed1e3-a8f1-4f36-801c-61217df4dbbf tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:50.250991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d86ed1e3-a8f1-4f36-801c-61217df4dbbf tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:50.251665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d86ed1e3-a8f1-4f36-801c-61217df4dbbf tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:50.517720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d86ed1e3-a8f1-4f36-801c-61217df4dbbf tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:50.532109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d86ed1e3-a8f1-4f36-801c-61217df4dbbf tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.303131 Jun 20 06:12:50.545527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 116/214] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:50 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:51.552488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3c1a508c-66f2-4bbf-a7d0-3086325ea412 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:51.553112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3c1a508c-66f2-4bbf-a7d0-3086325ea412 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:51.562341 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c1a508c-66f2-4bbf-a7d0-3086325ea412 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.563136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c1a508c-66f2-4bbf-a7d0-3086325ea412 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.564077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c1a508c-66f2-4bbf-a7d0-3086325ea412 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.564803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c1a508c-66f2-4bbf-a7d0-3086325ea412 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.703960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-876431696", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9962bf9-afc3-4bca-900b-7a55dc02f894"}], "security_groups": [{"name": "tempest-securitygroup--1614913732"}], "key_name": "tempest-keypair-674793659", "user_data": "}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:51.721525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3c1a508c-66f2-4bbf-a7d0-3086325ea412 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:51.730601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3c1a508c-66f2-4bbf-a7d0-3086325ea412 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.182311 Jun 20 06:12:51.731287 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 99/215] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:51 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:51.810701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] validate_networks() for [('e9962bf9-afc3-4bca-900b-7a55dc02f894', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:12:52.193116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:12:52.193630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:12:52.194096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:12:52.194493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:12:52.194891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:12:52.204318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.204766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.205585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.206013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.223274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for project fde00bac11024d898d6d87b8d2abc29e. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:12:52.227155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for user ee7405c2b1504907ba919e2797e63754 and project fde00bac11024d898d6d87b8d2abc29e. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:12:52.237917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:12:52.240163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:12:52.289076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-28f908ea-f740-4673-a2e2-0ddcae4c0fad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589251 Jun 20 06:12:52.289917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 117/216] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:12:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:12:52.299663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ae2c411-8b93-4df0-9bd3-c22b15f98614 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:52.300551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8ae2c411-8b93-4df0-9bd3-c22b15f98614 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:52.363187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8ae2c411-8b93-4df0-9bd3-c22b15f98614 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:52.371100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ae2c411-8b93-4df0-9bd3-c22b15f98614 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1240 microversion: 2.1 time: 0.075124 Jun 20 06:12:52.380788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 100/217] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:52 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:52.749937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db258270-8efb-4272-8631-f4a91542f73f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:52.752078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-db258270-8efb-4272-8631-f4a91542f73f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:52.765895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db258270-8efb-4272-8631-f4a91542f73f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.767280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db258270-8efb-4272-8631-f4a91542f73f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.769256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db258270-8efb-4272-8631-f4a91542f73f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.769977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db258270-8efb-4272-8631-f4a91542f73f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:53.062053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-db258270-8efb-4272-8631-f4a91542f73f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:53.075652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-db258270-8efb-4272-8631-f4a91542f73f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.330323 Jun 20 06:12:53.089298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 118/218] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:52 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:53.393310 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-be999ae3-053c-4c9b-ac2c-d7bbcc60bce0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:53.394021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-be999ae3-053c-4c9b-ac2c-d7bbcc60bce0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:53.402246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be999ae3-053c-4c9b-ac2c-d7bbcc60bce0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:53.402886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be999ae3-053c-4c9b-ac2c-d7bbcc60bce0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:53.403698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be999ae3-053c-4c9b-ac2c-d7bbcc60bce0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:53.404104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be999ae3-053c-4c9b-ac2c-d7bbcc60bce0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:53.562747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-be999ae3-053c-4c9b-ac2c-d7bbcc60bce0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:53.577097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-be999ae3-053c-4c9b-ac2c-d7bbcc60bce0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1292 microversion: 2.1 time: 0.187752 Jun 20 06:12:53.580405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 101/219] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:53 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1292 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:54.093062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-72f0e26e-2882-4a99-8c09-15bfdca4172b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:54.093808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-72f0e26e-2882-4a99-8c09-15bfdca4172b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:54.103388 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72f0e26e-2882-4a99-8c09-15bfdca4172b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:54.103980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72f0e26e-2882-4a99-8c09-15bfdca4172b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:54.105707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72f0e26e-2882-4a99-8c09-15bfdca4172b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:54.106424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72f0e26e-2882-4a99-8c09-15bfdca4172b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:54.315713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-72f0e26e-2882-4a99-8c09-15bfdca4172b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:54.323801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-72f0e26e-2882-4a99-8c09-15bfdca4172b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.234960 Jun 20 06:12:54.324375 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 119/220] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:54 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:54.596240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d066591-2388-4e55-8684-3c9ed37bd141 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:54.596920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d066591-2388-4e55-8684-3c9ed37bd141 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:54.604422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d066591-2388-4e55-8684-3c9ed37bd141 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:54.604944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d066591-2388-4e55-8684-3c9ed37bd141 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:54.605841 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d066591-2388-4e55-8684-3c9ed37bd141 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:54.606337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d066591-2388-4e55-8684-3c9ed37bd141 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:54.818720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d066591-2388-4e55-8684-3c9ed37bd141 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:54.828252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d066591-2388-4e55-8684-3c9ed37bd141 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.235624 Jun 20 06:12:54.832177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 102/221] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:54 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:55.341164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-89da9721-843e-4f0b-9a66-4197c51416a0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:55.341816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-89da9721-843e-4f0b-9a66-4197c51416a0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:55.347997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89da9721-843e-4f0b-9a66-4197c51416a0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:55.348305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89da9721-843e-4f0b-9a66-4197c51416a0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:55.349036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89da9721-843e-4f0b-9a66-4197c51416a0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:55.349746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89da9721-843e-4f0b-9a66-4197c51416a0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:55.608557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-89da9721-843e-4f0b-9a66-4197c51416a0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:55.622229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-89da9721-843e-4f0b-9a66-4197c51416a0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.285695 Jun 20 06:12:55.622901 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 120/222] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:55 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:55.850178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a32580ed-b610-44ea-9993-eb5b564a632f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:55.851611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a32580ed-b610-44ea-9993-eb5b564a632f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:55.859506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a32580ed-b610-44ea-9993-eb5b564a632f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:55.859960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a32580ed-b610-44ea-9993-eb5b564a632f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:55.860753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a32580ed-b610-44ea-9993-eb5b564a632f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:55.861317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a32580ed-b610-44ea-9993-eb5b564a632f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:56.006905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a32580ed-b610-44ea-9993-eb5b564a632f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:56.017756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a32580ed-b610-44ea-9993-eb5b564a632f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.173509 Jun 20 06:12:56.018335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 103/223] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:55 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:56.639588 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-783e2652-8634-4718-bed6-9cea2730472e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:56.640330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-783e2652-8634-4718-bed6-9cea2730472e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:56.647897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-783e2652-8634-4718-bed6-9cea2730472e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:56.648352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-783e2652-8634-4718-bed6-9cea2730472e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:56.650263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-783e2652-8634-4718-bed6-9cea2730472e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:56.650721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-783e2652-8634-4718-bed6-9cea2730472e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:57.000919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-783e2652-8634-4718-bed6-9cea2730472e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:57.012019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-783e2652-8634-4718-bed6-9cea2730472e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.376086 Jun 20 06:12:57.013712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 121/224] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:56 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:57.048004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-23eae985-3c55-4f84-bc17-2fb6c9e508cd tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:57.053032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-23eae985-3c55-4f84-bc17-2fb6c9e508cd tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:57.088251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23eae985-3c55-4f84-bc17-2fb6c9e508cd tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:57.088714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23eae985-3c55-4f84-bc17-2fb6c9e508cd tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:57.101014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23eae985-3c55-4f84-bc17-2fb6c9e508cd tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:57.102234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23eae985-3c55-4f84-bc17-2fb6c9e508cd tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:57.561109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-6d0d82c7-fdc2-4194-a1d2-275d06d1e89f req-402b2f78-d0b4-41c7-b6e0-eae4153d7893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa304480-6854-41f6-8fdc-6cf9581ca96f", "tag": "3e696beb-43da-47a0-bfcd-4048ff26344f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:57.595479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-6d0d82c7-fdc2-4194-a1d2-275d06d1e89f req-402b2f78-d0b4-41c7-b6e0-eae4153d7893 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:57.596164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-6d0d82c7-fdc2-4194-a1d2-275d06d1e89f req-402b2f78-d0b4-41c7-b6e0-eae4153d7893 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:57.618619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:57.630288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-6d0d82c7-fdc2-4194-a1d2-275d06d1e89f req-402b2f78-d0b4-41c7-b6e0-eae4153d7893 service nova] Creating event network-changed:3e696beb-43da-47a0-bfcd-4048ff26344f for instance aa304480-6854-41f6-8fdc-6cf9581ca96f on hv-cinder-80473 Jun 20 06:12:57.640089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-6d0d82c7-fdc2-4194-a1d2-275d06d1e89f req-402b2f78-d0b4-41c7-b6e0-eae4153d7893 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086162 Jun 20 06:12:57.641678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 122/225] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:57.656434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-23eae985-3c55-4f84-bc17-2fb6c9e508cd tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:57.667187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-23eae985-3c55-4f84-bc17-2fb6c9e508cd tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.633687 Jun 20 06:12:57.678497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 104/226] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:57 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:58.032533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d479901f-0bbf-4eb6-81d9-331a65be93ea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:58.033252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d479901f-0bbf-4eb6-81d9-331a65be93ea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:58.040812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d479901f-0bbf-4eb6-81d9-331a65be93ea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:58.041252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d479901f-0bbf-4eb6-81d9-331a65be93ea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:58.042219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d479901f-0bbf-4eb6-81d9-331a65be93ea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:58.042652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d479901f-0bbf-4eb6-81d9-331a65be93ea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:58.212972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d479901f-0bbf-4eb6-81d9-331a65be93ea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:58.222769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d479901f-0bbf-4eb6-81d9-331a65be93ea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1523 microversion: 2.1 time: 0.195948 Jun 20 06:12:58.223937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 123/227] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:58 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:58.701018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63f8df25-3357-4159-ba1b-79e502776019 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:58.702684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63f8df25-3357-4159-ba1b-79e502776019 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:58.710653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f8df25-3357-4159-ba1b-79e502776019 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:58.712735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f8df25-3357-4159-ba1b-79e502776019 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:58.713634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f8df25-3357-4159-ba1b-79e502776019 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:58.714279 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f8df25-3357-4159-ba1b-79e502776019 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:58.913237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-63f8df25-3357-4159-ba1b-79e502776019 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:58.926202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-63f8df25-3357-4159-ba1b-79e502776019 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.238067 Jun 20 06:12:58.927573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 105/228] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:58 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:59.241428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-717ed16c-f2d2-4b29-9620-ba82713ac346 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:59.242051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-717ed16c-f2d2-4b29-9620-ba82713ac346 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:59.257864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-717ed16c-f2d2-4b29-9620-ba82713ac346 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.258734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-717ed16c-f2d2-4b29-9620-ba82713ac346 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.263599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-717ed16c-f2d2-4b29-9620-ba82713ac346 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.264092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-717ed16c-f2d2-4b29-9620-ba82713ac346 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.638532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-717ed16c-f2d2-4b29-9620-ba82713ac346 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:59.648671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-717ed16c-f2d2-4b29-9620-ba82713ac346 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1503 microversion: 2.1 time: 0.411358 Jun 20 06:12:59.649251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 124/229] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:59 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:59.666402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-87af1077-62cf-4d6a-9b94-10650941d84f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:59.667060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-87af1077-62cf-4d6a-9b94-10650941d84f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:59.674431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87af1077-62cf-4d6a-9b94-10650941d84f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.674934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87af1077-62cf-4d6a-9b94-10650941d84f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.675748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87af1077-62cf-4d6a-9b94-10650941d84f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.676193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87af1077-62cf-4d6a-9b94-10650941d84f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.681579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:59.915205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-87af1077-62cf-4d6a-9b94-10650941d84f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:59.925288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-87af1077-62cf-4d6a-9b94-10650941d84f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1516 microversion: 2.1 time: 0.263987 Jun 20 06:12:59.926378 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 106/230] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:59 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:59.954526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3e140bef-0cce-41eb-9331-de4b5aeb3319 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:59.955271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3e140bef-0cce-41eb-9331-de4b5aeb3319 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:59.962011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e140bef-0cce-41eb-9331-de4b5aeb3319 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.963423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e140bef-0cce-41eb-9331-de4b5aeb3319 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.963423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e140bef-0cce-41eb-9331-de4b5aeb3319 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.963816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e140bef-0cce-41eb-9331-de4b5aeb3319 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:00.255965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3e140bef-0cce-41eb-9331-de4b5aeb3319 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:00.265528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3e140bef-0cce-41eb-9331-de4b5aeb3319 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.315816 Jun 20 06:13:00.266590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 125/231] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:59 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:01.284137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bba334d5-ed35-4e68-98b9-41449cd9d9d9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:01.284748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bba334d5-ed35-4e68-98b9-41449cd9d9d9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:01.291302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bba334d5-ed35-4e68-98b9-41449cd9d9d9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.291747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bba334d5-ed35-4e68-98b9-41449cd9d9d9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.292508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bba334d5-ed35-4e68-98b9-41449cd9d9d9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.292943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bba334d5-ed35-4e68-98b9-41449cd9d9d9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.433431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bba334d5-ed35-4e68-98b9-41449cd9d9d9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:01.442200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bba334d5-ed35-4e68-98b9-41449cd9d9d9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.161685 Jun 20 06:13:01.442863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 107/232] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:01 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:01.584607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5bb3687d-9438-4699-badb-44d71b9e520b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:01.585598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5bb3687d-9438-4699-badb-44d71b9e520b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:01.592207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bb3687d-9438-4699-badb-44d71b9e520b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.592746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bb3687d-9438-4699-badb-44d71b9e520b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.593765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bb3687d-9438-4699-badb-44d71b9e520b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.594398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bb3687d-9438-4699-badb-44d71b9e520b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.624781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-5bb3687d-9438-4699-badb-44d71b9e520b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lazy-loading 'flavor' on Instance uuid 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:13:01.707725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5bb3687d-9438-4699-badb-44d71b9e520b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d/action" status: 200 len: 32 microversion: 2.1 time: 0.127418 Jun 20 06:13:01.708239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 126/233] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:13:01 2022] POST /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:13:01.717436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-84f04dde-1626-440f-a3c1-95a480a9bd16 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:01.718125 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-84f04dde-1626-440f-a3c1-95a480a9bd16 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:01.724532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84f04dde-1626-440f-a3c1-95a480a9bd16 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.724974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84f04dde-1626-440f-a3c1-95a480a9bd16 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.725770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84f04dde-1626-440f-a3c1-95a480a9bd16 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.726388 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84f04dde-1626-440f-a3c1-95a480a9bd16 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.866952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84f04dde-1626-440f-a3c1-95a480a9bd16 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:01.875354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-84f04dde-1626-440f-a3c1-95a480a9bd16 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.161379 Jun 20 06:13:01.875922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 108/234] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:01 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:02.459219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:02.459994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:02.464400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8f0d80e5-7503-43fc-8b09-5400683d868c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:02.465097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8f0d80e5-7503-43fc-8b09-5400683d868c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:02.472357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f0d80e5-7503-43fc-8b09-5400683d868c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:02.473048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f0d80e5-7503-43fc-8b09-5400683d868c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:02.474064 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f0d80e5-7503-43fc-8b09-5400683d868c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:02.474653 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f0d80e5-7503-43fc-8b09-5400683d868c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:02.809887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8f0d80e5-7503-43fc-8b09-5400683d868c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:02.829416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8f0d80e5-7503-43fc-8b09-5400683d868c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.370737 Jun 20 06:13:02.830155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 127/235] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:02 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:02.893794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-005605c9-c58e-476d-a7e0-049a94ff9ec2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:02.894348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-005605c9-c58e-476d-a7e0-049a94ff9ec2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:02.897708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:02.913301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-005605c9-c58e-476d-a7e0-049a94ff9ec2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:02.913816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-005605c9-c58e-476d-a7e0-049a94ff9ec2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:02.914968 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-005605c9-c58e-476d-a7e0-049a94ff9ec2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:02.915434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-005605c9-c58e-476d-a7e0-049a94ff9ec2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:03.021289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1791706575", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "networks": [{"uuid": "a2a155a6-b0ae-46dd-8198-5fe21e342de2"}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:03.103705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] validate_networks() for [('a2a155a6-b0ae-46dd-8198-5fe21e342de2', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:13:03.249785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-005605c9-c58e-476d-a7e0-049a94ff9ec2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:03.260121 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-005605c9-c58e-476d-a7e0-049a94ff9ec2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.371470 Jun 20 06:13:03.261163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 109/236] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:02 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:03.576628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:13:03.577930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:13:03.578479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:13:03.579262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:13:03.579984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:13:03.596899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:03.598005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:03.598917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:03.599416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:03.628823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Getting quotas for project b23bb3e50977480db739a786dcf9827a. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:13:03.633917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Getting quotas for user d1e03bec18c849e79bf2ce04ea496f62 and project b23bb3e50977480db739a786dcf9827a. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:13:03.649737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:13:03.651980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:13:03.706908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f6693def-e7b8-4fae-8988-d2e34f9ee3e7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690466 Jun 20 06:13:03.707744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 128/237] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:13:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:13:03.718169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-beb13cf4-5871-4b1f-919e-f2baa77490b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:03.718863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-beb13cf4-5871-4b1f-919e-f2baa77490b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:03.800059 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-beb13cf4-5871-4b1f-919e-f2baa77490b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:03.809617 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-beb13cf4-5871-4b1f-919e-f2baa77490b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1214 microversion: 2.1 time: 0.095242 Jun 20 06:13:03.810327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 110/238] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:03 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:03.852386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f95f903d-ce6b-4fac-9445-259d310af2e4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:03.854401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f95f903d-ce6b-4fac-9445-259d310af2e4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:03.862609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f95f903d-ce6b-4fac-9445-259d310af2e4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:03.863609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f95f903d-ce6b-4fac-9445-259d310af2e4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:03.864708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f95f903d-ce6b-4fac-9445-259d310af2e4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:03.865146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f95f903d-ce6b-4fac-9445-259d310af2e4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.044199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f95f903d-ce6b-4fac-9445-259d310af2e4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:04.055415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f95f903d-ce6b-4fac-9445-259d310af2e4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.211081 Jun 20 06:13:04.056344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 129/239] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:03 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:04.277194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74596afc-7395-4d0e-b779-f4f10877dff1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:04.278236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74596afc-7395-4d0e-b779-f4f10877dff1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:04.285197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74596afc-7395-4d0e-b779-f4f10877dff1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.285758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74596afc-7395-4d0e-b779-f4f10877dff1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.286534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74596afc-7395-4d0e-b779-f4f10877dff1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.286977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74596afc-7395-4d0e-b779-f4f10877dff1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.435899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-74596afc-7395-4d0e-b779-f4f10877dff1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:04.444999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74596afc-7395-4d0e-b779-f4f10877dff1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.172104 Jun 20 06:13:04.446330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 111/240] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:04 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:04.827486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f5295eda-265a-4129-ad6f-cc341724914b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:04.828098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f5295eda-265a-4129-ad6f-cc341724914b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:04.835556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5295eda-265a-4129-ad6f-cc341724914b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.836670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5295eda-265a-4129-ad6f-cc341724914b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.837815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5295eda-265a-4129-ad6f-cc341724914b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.838257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5295eda-265a-4129-ad6f-cc341724914b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.908091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f5295eda-265a-4129-ad6f-cc341724914b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:04.916036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f5295eda-265a-4129-ad6f-cc341724914b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1218 microversion: 2.1 time: 0.092442 Jun 20 06:13:04.916612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 130/241] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:04 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:05.074391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-591bff83-5099-42e1-abdf-ea2b1bbfb00b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:05.075003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-591bff83-5099-42e1-abdf-ea2b1bbfb00b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:05.081197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-591bff83-5099-42e1-abdf-ea2b1bbfb00b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:05.081670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-591bff83-5099-42e1-abdf-ea2b1bbfb00b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:05.082453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-591bff83-5099-42e1-abdf-ea2b1bbfb00b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:05.082912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-591bff83-5099-42e1-abdf-ea2b1bbfb00b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:05.226283 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-591bff83-5099-42e1-abdf-ea2b1bbfb00b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:05.243509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-591bff83-5099-42e1-abdf-ea2b1bbfb00b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.173280 Jun 20 06:13:05.244249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 112/242] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:05 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:05.469847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3720d3cb-01e5-4eb6-bf5b-57cab017813d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:05.470790 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3720d3cb-01e5-4eb6-bf5b-57cab017813d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:05.479467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3720d3cb-01e5-4eb6-bf5b-57cab017813d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:05.480102 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3720d3cb-01e5-4eb6-bf5b-57cab017813d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:05.481124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3720d3cb-01e5-4eb6-bf5b-57cab017813d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:05.481811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3720d3cb-01e5-4eb6-bf5b-57cab017813d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:05.623609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3720d3cb-01e5-4eb6-bf5b-57cab017813d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:05.631078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3720d3cb-01e5-4eb6-bf5b-57cab017813d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.166558 Jun 20 06:13:05.631643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 131/243] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:05 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:05.932591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-35f08c51-bb48-4ec7-8faa-ba83459a0759 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:05.933202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-35f08c51-bb48-4ec7-8faa-ba83459a0759 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:05.939923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35f08c51-bb48-4ec7-8faa-ba83459a0759 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:05.940376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35f08c51-bb48-4ec7-8faa-ba83459a0759 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:05.941148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35f08c51-bb48-4ec7-8faa-ba83459a0759 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:05.941632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35f08c51-bb48-4ec7-8faa-ba83459a0759 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:06.004486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-35f08c51-bb48-4ec7-8faa-ba83459a0759 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:06.012679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-35f08c51-bb48-4ec7-8faa-ba83459a0759 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1218 microversion: 2.1 time: 0.084570 Jun 20 06:13:06.013315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 113/244] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:05 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:06.260626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0f592c25-ec40-4a6f-a99e-2a1be1f1e227 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:06.261231 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0f592c25-ec40-4a6f-a99e-2a1be1f1e227 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:06.267259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f592c25-ec40-4a6f-a99e-2a1be1f1e227 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:06.267702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f592c25-ec40-4a6f-a99e-2a1be1f1e227 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:06.268590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f592c25-ec40-4a6f-a99e-2a1be1f1e227 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:06.269019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f592c25-ec40-4a6f-a99e-2a1be1f1e227 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:06.406513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0f592c25-ec40-4a6f-a99e-2a1be1f1e227 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:06.414617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0f592c25-ec40-4a6f-a99e-2a1be1f1e227 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.157888 Jun 20 06:13:06.415319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 132/245] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:06 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:06.649112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1991603e-6795-4b9b-bd94-3ef1e587f7c2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:06.649842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1991603e-6795-4b9b-bd94-3ef1e587f7c2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:06.655943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1991603e-6795-4b9b-bd94-3ef1e587f7c2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:06.656396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1991603e-6795-4b9b-bd94-3ef1e587f7c2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:06.657163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1991603e-6795-4b9b-bd94-3ef1e587f7c2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:06.657627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1991603e-6795-4b9b-bd94-3ef1e587f7c2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:06.806108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1991603e-6795-4b9b-bd94-3ef1e587f7c2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:06.813617 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1991603e-6795-4b9b-bd94-3ef1e587f7c2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.169029 Jun 20 06:13:06.814180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 114/246] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:06 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:07.031709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ac38f4b2-0bd6-4d61-b771-1358c1fcbab9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:07.032324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ac38f4b2-0bd6-4d61-b771-1358c1fcbab9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:07.038526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac38f4b2-0bd6-4d61-b771-1358c1fcbab9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.039005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac38f4b2-0bd6-4d61-b771-1358c1fcbab9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.039730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac38f4b2-0bd6-4d61-b771-1358c1fcbab9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.040164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac38f4b2-0bd6-4d61-b771-1358c1fcbab9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.105712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ac38f4b2-0bd6-4d61-b771-1358c1fcbab9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:07.113796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ac38f4b2-0bd6-4d61-b771-1358c1fcbab9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1218 microversion: 2.1 time: 0.085906 Jun 20 06:13:07.114369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 133/247] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:07 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:07.431395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dc326a4d-2c05-46c4-ab2a-d962fbeef0b2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:07.432033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dc326a4d-2c05-46c4-ab2a-d962fbeef0b2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:07.438554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc326a4d-2c05-46c4-ab2a-d962fbeef0b2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.439000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc326a4d-2c05-46c4-ab2a-d962fbeef0b2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.439760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc326a4d-2c05-46c4-ab2a-d962fbeef0b2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.440190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc326a4d-2c05-46c4-ab2a-d962fbeef0b2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.572378 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc326a4d-2c05-46c4-ab2a-d962fbeef0b2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:07.579948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dc326a4d-2c05-46c4-ab2a-d962fbeef0b2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.152373 Jun 20 06:13:07.580546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 115/248] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:07 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:07.831386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-75a54c2d-53dc-45cd-94bf-ebba0e9a8531 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:07.831921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-75a54c2d-53dc-45cd-94bf-ebba0e9a8531 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:07.838404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75a54c2d-53dc-45cd-94bf-ebba0e9a8531 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.838848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75a54c2d-53dc-45cd-94bf-ebba0e9a8531 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.839606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75a54c2d-53dc-45cd-94bf-ebba0e9a8531 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.840044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75a54c2d-53dc-45cd-94bf-ebba0e9a8531 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.968604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-75a54c2d-53dc-45cd-94bf-ebba0e9a8531 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:07.975892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-75a54c2d-53dc-45cd-94bf-ebba0e9a8531 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.148381 Jun 20 06:13:07.977062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 134/249] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:07 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:08.132076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-563ceed7-bbe6-4876-a506-0699ba5aa343 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:08.132741 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-563ceed7-bbe6-4876-a506-0699ba5aa343 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:08.139319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-563ceed7-bbe6-4876-a506-0699ba5aa343 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:08.139771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-563ceed7-bbe6-4876-a506-0699ba5aa343 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:08.140544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-563ceed7-bbe6-4876-a506-0699ba5aa343 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:08.140985 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-563ceed7-bbe6-4876-a506-0699ba5aa343 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:08.206148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-563ceed7-bbe6-4876-a506-0699ba5aa343 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:08.214487 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-563ceed7-bbe6-4876-a506-0699ba5aa343 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1210 microversion: 2.1 time: 0.086180 Jun 20 06:13:08.215133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 116/250] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:08 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:08.596242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a56cf612-8b07-411e-9dd4-919db0e3769e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:08.597247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a56cf612-8b07-411e-9dd4-919db0e3769e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:08.604431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a56cf612-8b07-411e-9dd4-919db0e3769e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:08.604968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a56cf612-8b07-411e-9dd4-919db0e3769e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:08.605883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a56cf612-8b07-411e-9dd4-919db0e3769e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:08.606389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a56cf612-8b07-411e-9dd4-919db0e3769e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:08.749340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a56cf612-8b07-411e-9dd4-919db0e3769e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:08.756702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a56cf612-8b07-411e-9dd4-919db0e3769e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.164483 Jun 20 06:13:08.757271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 135/251] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:08 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:08.994394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-429069d5-003e-40e4-9258-4ab2c8da0231 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:08.995008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-429069d5-003e-40e4-9258-4ab2c8da0231 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:09.002416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-429069d5-003e-40e4-9258-4ab2c8da0231 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:09.003043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-429069d5-003e-40e4-9258-4ab2c8da0231 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:09.003978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-429069d5-003e-40e4-9258-4ab2c8da0231 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:09.004519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-429069d5-003e-40e4-9258-4ab2c8da0231 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:09.146799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-429069d5-003e-40e4-9258-4ab2c8da0231 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:09.154650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-429069d5-003e-40e4-9258-4ab2c8da0231 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.164614 Jun 20 06:13:09.155207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 117/252] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:08 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:09.233621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-06e54740-e005-486a-918d-d9506dc7e928 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:09.234304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-06e54740-e005-486a-918d-d9506dc7e928 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:09.241933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06e54740-e005-486a-918d-d9506dc7e928 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:09.243652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06e54740-e005-486a-918d-d9506dc7e928 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:09.244690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06e54740-e005-486a-918d-d9506dc7e928 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:09.245267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06e54740-e005-486a-918d-d9506dc7e928 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:09.320118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-06e54740-e005-486a-918d-d9506dc7e928 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:09.330830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-06e54740-e005-486a-918d-d9506dc7e928 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1266 microversion: 2.1 time: 0.101123 Jun 20 06:13:09.344690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 136/253] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:09 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:09.776113 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5fbb29ef-0b0d-496a-bb02-04016726c885 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:09.777199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5fbb29ef-0b0d-496a-bb02-04016726c885 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:09.785472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fbb29ef-0b0d-496a-bb02-04016726c885 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:09.785946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fbb29ef-0b0d-496a-bb02-04016726c885 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:09.786717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fbb29ef-0b0d-496a-bb02-04016726c885 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:09.787150 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fbb29ef-0b0d-496a-bb02-04016726c885 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:10.173172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2461003e-00ee-487f-83c3-1a2aa21a786e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:10.173857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2461003e-00ee-487f-83c3-1a2aa21a786e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:10.180499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2461003e-00ee-487f-83c3-1a2aa21a786e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:10.180938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2461003e-00ee-487f-83c3-1a2aa21a786e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:10.181719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2461003e-00ee-487f-83c3-1a2aa21a786e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:10.182148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2461003e-00ee-487f-83c3-1a2aa21a786e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:10.412080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fbb29ef-0b0d-496a-bb02-04016726c885 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:10.420593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5fbb29ef-0b0d-496a-bb02-04016726c885 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.649028 Jun 20 06:13:10.421180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 118/254] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:09 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:10.425844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-41b388fc-7708-4c96-9b84-a5243b41a256 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:10.426590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-41b388fc-7708-4c96-9b84-a5243b41a256 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:10.432503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41b388fc-7708-4c96-9b84-a5243b41a256 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:10.432945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41b388fc-7708-4c96-9b84-a5243b41a256 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:10.433901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41b388fc-7708-4c96-9b84-a5243b41a256 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:10.434376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41b388fc-7708-4c96-9b84-a5243b41a256 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:10.527619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2461003e-00ee-487f-83c3-1a2aa21a786e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:10.535340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2461003e-00ee-487f-83c3-1a2aa21a786e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.365905 Jun 20 06:13:10.536246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 137/255] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:10 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:10.619676 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-f9b1fcf1-76b2-4164-833a-e58a0b08d722 req-a748dfad-1dc8-4cb3-b050-8f135b1c6be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa304480-6854-41f6-8fdc-6cf9581ca96f", "name": "network-vif-plugged", "status": "completed", "tag": "3e696beb-43da-47a0-bfcd-4048ff26344f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:10.629258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f9b1fcf1-76b2-4164-833a-e58a0b08d722 req-a748dfad-1dc8-4cb3-b050-8f135b1c6be3 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:10.629738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f9b1fcf1-76b2-4164-833a-e58a0b08d722 req-a748dfad-1dc8-4cb3-b050-8f135b1c6be3 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:10.634964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.647263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-f9b1fcf1-76b2-4164-833a-e58a0b08d722 req-a748dfad-1dc8-4cb3-b050-8f135b1c6be3 service nova] Creating event network-vif-plugged:3e696beb-43da-47a0-bfcd-4048ff26344f for instance aa304480-6854-41f6-8fdc-6cf9581ca96f on hv-cinder-80473 Jun 20 06:13:10.655360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-f9b1fcf1-76b2-4164-833a-e58a0b08d722 req-a748dfad-1dc8-4cb3-b050-8f135b1c6be3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039908 Jun 20 06:13:10.655964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 138/256] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:10.725192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-41b388fc-7708-4c96-9b84-a5243b41a256 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:10.741407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-41b388fc-7708-4c96-9b84-a5243b41a256 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.318925 Jun 20 06:13:10.742155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 119/257] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:10 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:11.438624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c4fd5133-d744-45d6-ac99-fad261d34589 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:11.439438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c4fd5133-d744-45d6-ac99-fad261d34589 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:11.445749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4fd5133-d744-45d6-ac99-fad261d34589 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:11.446283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4fd5133-d744-45d6-ac99-fad261d34589 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:11.447194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4fd5133-d744-45d6-ac99-fad261d34589 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:11.447641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4fd5133-d744-45d6-ac99-fad261d34589 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:11.473796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-6ba29452-ab69-447f-b9f4-3e06112a3e35 req-be48809d-65f3-4ee4-b863-a5540640ea26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8", "tag": "5a72e255-8fb2-4aae-96a9-72709143f912"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:11.486202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6ba29452-ab69-447f-b9f4-3e06112a3e35 req-be48809d-65f3-4ee4-b863-a5540640ea26 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:11.486774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6ba29452-ab69-447f-b9f4-3e06112a3e35 req-be48809d-65f3-4ee4-b863-a5540640ea26 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:11.509895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-6ba29452-ab69-447f-b9f4-3e06112a3e35 req-be48809d-65f3-4ee4-b863-a5540640ea26 service nova] Creating event network-changed:5a72e255-8fb2-4aae-96a9-72709143f912 for instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 on hv-cinder-80473 Jun 20 06:13:11.515182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-6ba29452-ab69-447f-b9f4-3e06112a3e35 req-be48809d-65f3-4ee4-b863-a5540640ea26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045758 Jun 20 06:13:11.515811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 120/258] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:11.552441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dec082ea-86a9-49fa-9a48-cfc318881eff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:11.553147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dec082ea-86a9-49fa-9a48-cfc318881eff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:11.561099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dec082ea-86a9-49fa-9a48-cfc318881eff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:11.561684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dec082ea-86a9-49fa-9a48-cfc318881eff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:11.562594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dec082ea-86a9-49fa-9a48-cfc318881eff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:11.563116 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dec082ea-86a9-49fa-9a48-cfc318881eff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:11.621776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c4fd5133-d744-45d6-ac99-fad261d34589 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:11.631071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c4fd5133-d744-45d6-ac99-fad261d34589 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.196901 Jun 20 06:13:11.632353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 139/259] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:11 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:11.714334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dec082ea-86a9-49fa-9a48-cfc318881eff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:11.722150 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dec082ea-86a9-49fa-9a48-cfc318881eff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.173882 Jun 20 06:13:11.722931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 121/260] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:11 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:11.759775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-598a8cb5-ee16-490e-a8f7-d06bfd34691e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:11.760389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-598a8cb5-ee16-490e-a8f7-d06bfd34691e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:11.766289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-598a8cb5-ee16-490e-a8f7-d06bfd34691e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:11.766761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-598a8cb5-ee16-490e-a8f7-d06bfd34691e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:11.767601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-598a8cb5-ee16-490e-a8f7-d06bfd34691e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:11.768096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-598a8cb5-ee16-490e-a8f7-d06bfd34691e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:11.906997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-598a8cb5-ee16-490e-a8f7-d06bfd34691e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:11.914483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-598a8cb5-ee16-490e-a8f7-d06bfd34691e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.159563 Jun 20 06:13:11.915041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 140/261] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:11 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:12.648743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7c1b755c-fc3d-4476-a1c4-002d9ed495d5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:12.649333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7c1b755c-fc3d-4476-a1c4-002d9ed495d5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:12.656090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c1b755c-fc3d-4476-a1c4-002d9ed495d5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:12.656567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c1b755c-fc3d-4476-a1c4-002d9ed495d5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:12.657372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c1b755c-fc3d-4476-a1c4-002d9ed495d5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:12.657870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c1b755c-fc3d-4476-a1c4-002d9ed495d5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:12.739021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cb09ac45-be6e-4d7d-90eb-9bf2b5e80de2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:12.739630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cb09ac45-be6e-4d7d-90eb-9bf2b5e80de2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:12.749758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cb09ac45-be6e-4d7d-90eb-9bf2b5e80de2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:12.750207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cb09ac45-be6e-4d7d-90eb-9bf2b5e80de2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:12.751029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cb09ac45-be6e-4d7d-90eb-9bf2b5e80de2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:12.751643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cb09ac45-be6e-4d7d-90eb-9bf2b5e80de2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:12.881172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7c1b755c-fc3d-4476-a1c4-002d9ed495d5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:12.890527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7c1b755c-fc3d-4476-a1c4-002d9ed495d5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1366 microversion: 2.1 time: 0.245800 Jun 20 06:13:12.891105 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 122/262] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:12 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:12.931604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cb09ac45-be6e-4d7d-90eb-9bf2b5e80de2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:12.932033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dc783f46-5a30-4771-91ae-1879d7a01c13 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:12.932644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dc783f46-5a30-4771-91ae-1879d7a01c13 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:12.938871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc783f46-5a30-4771-91ae-1879d7a01c13 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:12.939563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc783f46-5a30-4771-91ae-1879d7a01c13 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:12.939986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cb09ac45-be6e-4d7d-90eb-9bf2b5e80de2 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.204590 Jun 20 06:13:12.940344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc783f46-5a30-4771-91ae-1879d7a01c13 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:12.940781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc783f46-5a30-4771-91ae-1879d7a01c13 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:12.943338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 141/263] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:12 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:13.260531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc783f46-5a30-4771-91ae-1879d7a01c13 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:13.268040 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dc783f46-5a30-4771-91ae-1879d7a01c13 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.340931 Jun 20 06:13:13.268606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 123/264] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:12 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:13.908172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ba4107de-70b1-47db-8211-3d858eeacaa2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:13.908776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ba4107de-70b1-47db-8211-3d858eeacaa2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:13.910952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:13.911725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:13.919121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba4107de-70b1-47db-8211-3d858eeacaa2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:13.919561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba4107de-70b1-47db-8211-3d858eeacaa2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:13.920412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba4107de-70b1-47db-8211-3d858eeacaa2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:13.920920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba4107de-70b1-47db-8211-3d858eeacaa2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:13.957472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-268712e9-92e7-479a-a206-293d6a99f138 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:13.958081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-268712e9-92e7-479a-a206-293d6a99f138 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:13.961042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:13.967200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-268712e9-92e7-479a-a206-293d6a99f138 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:13.967657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-268712e9-92e7-479a-a206-293d6a99f138 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:13.968425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-268712e9-92e7-479a-a206-293d6a99f138 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:13.968866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-268712e9-92e7-479a-a206-293d6a99f138 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:13.990588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:14.112699 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ba4107de-70b1-47db-8211-3d858eeacaa2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:14.120139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ba4107de-70b1-47db-8211-3d858eeacaa2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1556 microversion: 2.1 time: 0.216284 Jun 20 06:13:14.120631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 142/265] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:13 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:14.138138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8ab200c3-7de0-4a5f-8e35-1ea7639eb619 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:14.138773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8ab200c3-7de0-4a5f-8e35-1ea7639eb619 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:14.144479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-268712e9-92e7-479a-a206-293d6a99f138 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:14.145099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ab200c3-7de0-4a5f-8e35-1ea7639eb619 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:14.145829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ab200c3-7de0-4a5f-8e35-1ea7639eb619 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:14.146592 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ab200c3-7de0-4a5f-8e35-1ea7639eb619 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:14.147018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ab200c3-7de0-4a5f-8e35-1ea7639eb619 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:14.152982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-268712e9-92e7-479a-a206-293d6a99f138 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.199333 Jun 20 06:13:14.154091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 124/266] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:13 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:14.239816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8ab200c3-7de0-4a5f-8e35-1ea7639eb619 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107147 Jun 20 06:13:14.240522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 143/267] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jun 20 06:13:14 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:14.289654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1e457dd2-2d6e-476f-bfe5-1cbb771df1f0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:14.290648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1e457dd2-2d6e-476f-bfe5-1cbb771df1f0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:14.301858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e457dd2-2d6e-476f-bfe5-1cbb771df1f0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:14.303830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e457dd2-2d6e-476f-bfe5-1cbb771df1f0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:14.304930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e457dd2-2d6e-476f-bfe5-1cbb771df1f0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:14.305706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e457dd2-2d6e-476f-bfe5-1cbb771df1f0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:14.544943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1e457dd2-2d6e-476f-bfe5-1cbb771df1f0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:14.556048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1e457dd2-2d6e-476f-bfe5-1cbb771df1f0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.274320 Jun 20 06:13:14.557222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 125/268] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:14 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:15.170382 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8bee3e6f-94ec-4250-a6aa-2a43dabeb13d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:15.171026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8bee3e6f-94ec-4250-a6aa-2a43dabeb13d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:15.176921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bee3e6f-94ec-4250-a6aa-2a43dabeb13d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:15.177367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bee3e6f-94ec-4250-a6aa-2a43dabeb13d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:15.178159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bee3e6f-94ec-4250-a6aa-2a43dabeb13d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:15.178596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bee3e6f-94ec-4250-a6aa-2a43dabeb13d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:15.313992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8bee3e6f-94ec-4250-a6aa-2a43dabeb13d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:15.328258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8bee3e6f-94ec-4250-a6aa-2a43dabeb13d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.161767 Jun 20 06:13:15.329470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 144/269] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:15 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:15.573515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-055d133d-04d5-4c40-b741-8253876f6a0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:15.574211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-055d133d-04d5-4c40-b741-8253876f6a0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:15.580959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-055d133d-04d5-4c40-b741-8253876f6a0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:15.581628 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-055d133d-04d5-4c40-b741-8253876f6a0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:15.582485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-055d133d-04d5-4c40-b741-8253876f6a0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:15.582995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-055d133d-04d5-4c40-b741-8253876f6a0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:15.602254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-68744bdc-cede-482d-88b6-78c4713c9547 req-417a480a-f9e5-43ee-ad98-1802745644be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa304480-6854-41f6-8fdc-6cf9581ca96f", "tag": "3e696beb-43da-47a0-bfcd-4048ff26344f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:15.610879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-68744bdc-cede-482d-88b6-78c4713c9547 req-417a480a-f9e5-43ee-ad98-1802745644be service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:15.611568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-68744bdc-cede-482d-88b6-78c4713c9547 req-417a480a-f9e5-43ee-ad98-1802745644be service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:15.633160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-68744bdc-cede-482d-88b6-78c4713c9547 req-417a480a-f9e5-43ee-ad98-1802745644be service nova] Creating event network-changed:3e696beb-43da-47a0-bfcd-4048ff26344f for instance aa304480-6854-41f6-8fdc-6cf9581ca96f on hv-cinder-80473 Jun 20 06:13:15.639557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-68744bdc-cede-482d-88b6-78c4713c9547 req-417a480a-f9e5-43ee-ad98-1802745644be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041751 Jun 20 06:13:15.640157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 145/270] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:15.723919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-055d133d-04d5-4c40-b741-8253876f6a0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:15.735506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-055d133d-04d5-4c40-b741-8253876f6a0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.165780 Jun 20 06:13:15.738211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 126/271] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:15 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:16.346070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d29f91e0-e8dd-42c9-aff3-14a71d92c56e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:16.346757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d29f91e0-e8dd-42c9-aff3-14a71d92c56e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:16.352903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d29f91e0-e8dd-42c9-aff3-14a71d92c56e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.353347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d29f91e0-e8dd-42c9-aff3-14a71d92c56e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.354249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d29f91e0-e8dd-42c9-aff3-14a71d92c56e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.354679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d29f91e0-e8dd-42c9-aff3-14a71d92c56e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.503026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d29f91e0-e8dd-42c9-aff3-14a71d92c56e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:16.509836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d29f91e0-e8dd-42c9-aff3-14a71d92c56e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.167186 Jun 20 06:13:16.511012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 146/272] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:16 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:16.751979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ed733540-eaaa-478e-b722-fa955fe15737 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:16.752584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ed733540-eaaa-478e-b722-fa955fe15737 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:16.759760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed733540-eaaa-478e-b722-fa955fe15737 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.760241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed733540-eaaa-478e-b722-fa955fe15737 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.760995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed733540-eaaa-478e-b722-fa955fe15737 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.761467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed733540-eaaa-478e-b722-fa955fe15737 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.901565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ed733540-eaaa-478e-b722-fa955fe15737 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:16.909646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ed733540-eaaa-478e-b722-fa955fe15737 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.161453 Jun 20 06:13:16.910323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 127/273] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:16 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:17.529520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-710baaa7-3dff-4d05-a86b-95bbd3d776fa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:17.530118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-710baaa7-3dff-4d05-a86b-95bbd3d776fa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:17.532529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:17.537895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-710baaa7-3dff-4d05-a86b-95bbd3d776fa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:17.538335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-710baaa7-3dff-4d05-a86b-95bbd3d776fa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:17.539393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-710baaa7-3dff-4d05-a86b-95bbd3d776fa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:17.539823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-710baaa7-3dff-4d05-a86b-95bbd3d776fa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:17.812832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-710baaa7-3dff-4d05-a86b-95bbd3d776fa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:17.821311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-710baaa7-3dff-4d05-a86b-95bbd3d776fa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.295845 Jun 20 06:13:17.821896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 147/274] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:17 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:17.927106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ecd28438-3760-4b33-bca8-cea002cbc88c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:17.927731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ecd28438-3760-4b33-bca8-cea002cbc88c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:17.934728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecd28438-3760-4b33-bca8-cea002cbc88c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:17.935168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecd28438-3760-4b33-bca8-cea002cbc88c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:17.935912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecd28438-3760-4b33-bca8-cea002cbc88c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:17.936340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecd28438-3760-4b33-bca8-cea002cbc88c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.068790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ecd28438-3760-4b33-bca8-cea002cbc88c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:18.077043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ecd28438-3760-4b33-bca8-cea002cbc88c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.153738 Jun 20 06:13:18.077884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 128/275] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:17 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:18.838067 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bd116aad-f52d-4846-b7cb-bc5b73e7821e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:18.838665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bd116aad-f52d-4846-b7cb-bc5b73e7821e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:18.845571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd116aad-f52d-4846-b7cb-bc5b73e7821e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:18.846041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd116aad-f52d-4846-b7cb-bc5b73e7821e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.846926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd116aad-f52d-4846-b7cb-bc5b73e7821e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:18.847355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd116aad-f52d-4846-b7cb-bc5b73e7821e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.976698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bd116aad-f52d-4846-b7cb-bc5b73e7821e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:18.984039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bd116aad-f52d-4846-b7cb-bc5b73e7821e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.150451 Jun 20 06:13:18.984588 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 148/276] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:18 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:19.093045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac1034e1-dfde-4bab-b7d6-b5569135263f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:19.093687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ac1034e1-dfde-4bab-b7d6-b5569135263f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:19.100324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac1034e1-dfde-4bab-b7d6-b5569135263f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:19.100773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac1034e1-dfde-4bab-b7d6-b5569135263f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:19.101825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac1034e1-dfde-4bab-b7d6-b5569135263f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:19.102258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac1034e1-dfde-4bab-b7d6-b5569135263f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:19.231687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ac1034e1-dfde-4bab-b7d6-b5569135263f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:19.239064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ac1034e1-dfde-4bab-b7d6-b5569135263f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.149949 Jun 20 06:13:19.239621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 129/277] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:19 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:20.000977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c2e13118-eb28-47a2-8ce2-82ebd5686fd8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:20.001632 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c2e13118-eb28-47a2-8ce2-82ebd5686fd8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:20.008159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c2e13118-eb28-47a2-8ce2-82ebd5686fd8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.008603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c2e13118-eb28-47a2-8ce2-82ebd5686fd8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.009358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c2e13118-eb28-47a2-8ce2-82ebd5686fd8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.009813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c2e13118-eb28-47a2-8ce2-82ebd5686fd8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.135586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c2e13118-eb28-47a2-8ce2-82ebd5686fd8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:20.143334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c2e13118-eb28-47a2-8ce2-82ebd5686fd8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.146121 Jun 20 06:13:20.143887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 149/278] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:19 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:20.257934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b16c9140-a9df-4c8b-8eba-87318fff1889 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:20.259099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b16c9140-a9df-4c8b-8eba-87318fff1889 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:20.261161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:20.266891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b16c9140-a9df-4c8b-8eba-87318fff1889 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.267345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b16c9140-a9df-4c8b-8eba-87318fff1889 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.268122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b16c9140-a9df-4c8b-8eba-87318fff1889 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.268550 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b16c9140-a9df-4c8b-8eba-87318fff1889 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.581536 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b16c9140-a9df-4c8b-8eba-87318fff1889 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:20.589592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b16c9140-a9df-4c8b-8eba-87318fff1889 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.337301 Jun 20 06:13:20.590157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 130/279] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:20 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:21.160391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4478dcf6-f825-4099-94a4-46aa4f068266 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:21.161024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4478dcf6-f825-4099-94a4-46aa4f068266 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:21.167723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4478dcf6-f825-4099-94a4-46aa4f068266 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:21.168168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4478dcf6-f825-4099-94a4-46aa4f068266 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:21.168923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4478dcf6-f825-4099-94a4-46aa4f068266 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:21.169356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4478dcf6-f825-4099-94a4-46aa4f068266 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:21.300096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4478dcf6-f825-4099-94a4-46aa4f068266 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:21.308045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4478dcf6-f825-4099-94a4-46aa4f068266 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.151520 Jun 20 06:13:21.308598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 150/280] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:21 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:21.606345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-de26c363-0a6d-44bc-8a6d-53e7b4dfa27a tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:21.606950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-de26c363-0a6d-44bc-8a6d-53e7b4dfa27a tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:21.613426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de26c363-0a6d-44bc-8a6d-53e7b4dfa27a tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:21.613898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de26c363-0a6d-44bc-8a6d-53e7b4dfa27a tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:21.614654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de26c363-0a6d-44bc-8a6d-53e7b4dfa27a tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:21.615083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de26c363-0a6d-44bc-8a6d-53e7b4dfa27a tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:21.745170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-de26c363-0a6d-44bc-8a6d-53e7b4dfa27a tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:21.752591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-de26c363-0a6d-44bc-8a6d-53e7b4dfa27a tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.150103 Jun 20 06:13:21.753145 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 131/281] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:21 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:22.325482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9b6aece4-0247-45b0-a060-108a2c112aad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:22.326018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9b6aece4-0247-45b0-a060-108a2c112aad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:22.332351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b6aece4-0247-45b0-a060-108a2c112aad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:22.332662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b6aece4-0247-45b0-a060-108a2c112aad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:22.333440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b6aece4-0247-45b0-a060-108a2c112aad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:22.333899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b6aece4-0247-45b0-a060-108a2c112aad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:22.463549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9b6aece4-0247-45b0-a060-108a2c112aad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:22.470826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9b6aece4-0247-45b0-a060-108a2c112aad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.149300 Jun 20 06:13:22.471372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 151/282] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:22 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:22.769146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f72a8438-8dfd-4fef-8baa-b7c75c49bd2d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:22.769771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f72a8438-8dfd-4fef-8baa-b7c75c49bd2d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:22.776482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f72a8438-8dfd-4fef-8baa-b7c75c49bd2d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:22.776927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f72a8438-8dfd-4fef-8baa-b7c75c49bd2d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:22.777843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f72a8438-8dfd-4fef-8baa-b7c75c49bd2d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:22.778268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f72a8438-8dfd-4fef-8baa-b7c75c49bd2d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:22.907947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f72a8438-8dfd-4fef-8baa-b7c75c49bd2d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:22.916144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f72a8438-8dfd-4fef-8baa-b7c75c49bd2d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.150862 Jun 20 06:13:22.916694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 132/283] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:22 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:23.487926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bfe54500-9e5b-454e-abd7-57b286474777 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:23.488530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bfe54500-9e5b-454e-abd7-57b286474777 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:23.494796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfe54500-9e5b-454e-abd7-57b286474777 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:23.495240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfe54500-9e5b-454e-abd7-57b286474777 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:23.495986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfe54500-9e5b-454e-abd7-57b286474777 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:23.496413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfe54500-9e5b-454e-abd7-57b286474777 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:23.624206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bfe54500-9e5b-454e-abd7-57b286474777 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:23.631587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bfe54500-9e5b-454e-abd7-57b286474777 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.147616 Jun 20 06:13:23.632677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 152/284] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:23 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:23.934069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dedee402-8312-492f-abf8-76625acdbfe5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:23.935237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dedee402-8312-492f-abf8-76625acdbfe5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:23.941966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dedee402-8312-492f-abf8-76625acdbfe5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:23.942417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dedee402-8312-492f-abf8-76625acdbfe5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:23.943277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dedee402-8312-492f-abf8-76625acdbfe5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:23.943818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dedee402-8312-492f-abf8-76625acdbfe5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:24.084809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dedee402-8312-492f-abf8-76625acdbfe5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:24.092599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dedee402-8312-492f-abf8-76625acdbfe5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.164200 Jun 20 06:13:24.093166 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 133/285] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:23 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:24.648915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5a884e25-d6c2-404c-8696-b1182ac9855d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:24.649556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5a884e25-d6c2-404c-8696-b1182ac9855d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:24.655528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a884e25-d6c2-404c-8696-b1182ac9855d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:24.655978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a884e25-d6c2-404c-8696-b1182ac9855d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:24.656736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a884e25-d6c2-404c-8696-b1182ac9855d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:24.657172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a884e25-d6c2-404c-8696-b1182ac9855d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:24.787776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a884e25-d6c2-404c-8696-b1182ac9855d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:24.798669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5a884e25-d6c2-404c-8696-b1182ac9855d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.154416 Jun 20 06:13:24.799230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 153/286] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:24 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:25.109490 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-146a8bde-8a42-4c36-bc3a-545d674cface tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:25.110090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-146a8bde-8a42-4c36-bc3a-545d674cface tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:25.116493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-146a8bde-8a42-4c36-bc3a-545d674cface tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:25.116945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-146a8bde-8a42-4c36-bc3a-545d674cface tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.117724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-146a8bde-8a42-4c36-bc3a-545d674cface tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:25.118152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-146a8bde-8a42-4c36-bc3a-545d674cface tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.249817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-146a8bde-8a42-4c36-bc3a-545d674cface tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:25.258189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-146a8bde-8a42-4c36-bc3a-545d674cface tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.151465 Jun 20 06:13:25.258774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 134/287] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:25 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:25.816010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-711261a1-02e1-4c15-9f7a-6df30aa18cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:25.816773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-711261a1-02e1-4c15-9f7a-6df30aa18cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:25.822879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-711261a1-02e1-4c15-9f7a-6df30aa18cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:25.823324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-711261a1-02e1-4c15-9f7a-6df30aa18cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.824083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-711261a1-02e1-4c15-9f7a-6df30aa18cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:25.824517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-711261a1-02e1-4c15-9f7a-6df30aa18cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.952164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-711261a1-02e1-4c15-9f7a-6df30aa18cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:25.959471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-711261a1-02e1-4c15-9f7a-6df30aa18cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.147394 Jun 20 06:13:25.960026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 154/288] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:25 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:26.276164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8189279-c05e-4a64-b4bc-110d8f2d835f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:26.276770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8189279-c05e-4a64-b4bc-110d8f2d835f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:26.283297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8189279-c05e-4a64-b4bc-110d8f2d835f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:26.283742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8189279-c05e-4a64-b4bc-110d8f2d835f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:26.284501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8189279-c05e-4a64-b4bc-110d8f2d835f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:26.284934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8189279-c05e-4a64-b4bc-110d8f2d835f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:26.413673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8189279-c05e-4a64-b4bc-110d8f2d835f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:26.421054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8189279-c05e-4a64-b4bc-110d8f2d835f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.149791 Jun 20 06:13:26.421643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 135/289] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:26 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:26.976395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-add02f23-5333-41e1-af15-94a851dfe87f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:26.977054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-add02f23-5333-41e1-af15-94a851dfe87f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:26.983006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-add02f23-5333-41e1-af15-94a851dfe87f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:26.983451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-add02f23-5333-41e1-af15-94a851dfe87f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:26.984207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-add02f23-5333-41e1-af15-94a851dfe87f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:26.984640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-add02f23-5333-41e1-af15-94a851dfe87f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:27.115511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-add02f23-5333-41e1-af15-94a851dfe87f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:27.123527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-add02f23-5333-41e1-af15-94a851dfe87f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.151116 Jun 20 06:13:27.124073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 155/290] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:26 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:27.437936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c05e9d95-8e0c-497b-87be-aeda69ea93ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:27.438539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c05e9d95-8e0c-497b-87be-aeda69ea93ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:27.445177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c05e9d95-8e0c-497b-87be-aeda69ea93ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:27.445650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c05e9d95-8e0c-497b-87be-aeda69ea93ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:27.446403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c05e9d95-8e0c-497b-87be-aeda69ea93ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:27.446831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c05e9d95-8e0c-497b-87be-aeda69ea93ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:27.576021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c05e9d95-8e0c-497b-87be-aeda69ea93ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:27.583588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c05e9d95-8e0c-497b-87be-aeda69ea93ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.149492 Jun 20 06:13:27.584151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 136/291] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:27 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:28.139924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2615ee93-3c55-4343-a15b-0a155a6aa227 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:28.140545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2615ee93-3c55-4343-a15b-0a155a6aa227 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:28.146949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2615ee93-3c55-4343-a15b-0a155a6aa227 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:28.147393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2615ee93-3c55-4343-a15b-0a155a6aa227 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:28.148151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2615ee93-3c55-4343-a15b-0a155a6aa227 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:28.149221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2615ee93-3c55-4343-a15b-0a155a6aa227 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:28.168557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:28.281755 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2615ee93-3c55-4343-a15b-0a155a6aa227 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:28.290534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2615ee93-3c55-4343-a15b-0a155a6aa227 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.153127 Jun 20 06:13:28.291107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 156/292] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:28 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:28.601139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-432ba969-3008-43b0-b7b9-39b88647507c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:28.602249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-432ba969-3008-43b0-b7b9-39b88647507c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:28.608562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-432ba969-3008-43b0-b7b9-39b88647507c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:28.609003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-432ba969-3008-43b0-b7b9-39b88647507c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:28.609791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-432ba969-3008-43b0-b7b9-39b88647507c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:28.610225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-432ba969-3008-43b0-b7b9-39b88647507c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:28.877198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-432ba969-3008-43b0-b7b9-39b88647507c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:28.884619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-432ba969-3008-43b0-b7b9-39b88647507c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.287229 Jun 20 06:13:28.885179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 137/293] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:28 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:29.307761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-86a86043-7e1f-46bf-ac8c-ecc85e15cb14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:29.308370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-86a86043-7e1f-46bf-ac8c-ecc85e15cb14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:29.314542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86a86043-7e1f-46bf-ac8c-ecc85e15cb14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:29.314987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86a86043-7e1f-46bf-ac8c-ecc85e15cb14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:29.315755 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86a86043-7e1f-46bf-ac8c-ecc85e15cb14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:29.316184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86a86043-7e1f-46bf-ac8c-ecc85e15cb14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:29.444851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-86a86043-7e1f-46bf-ac8c-ecc85e15cb14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:29.452870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-86a86043-7e1f-46bf-ac8c-ecc85e15cb14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.149335 Jun 20 06:13:29.453421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 157/294] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:29 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:29.901565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8e70567c-7509-47b1-b686-ecdf32e30a05 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:29.902166 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8e70567c-7509-47b1-b686-ecdf32e30a05 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:29.908499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e70567c-7509-47b1-b686-ecdf32e30a05 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:29.908939 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e70567c-7509-47b1-b686-ecdf32e30a05 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:29.909705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e70567c-7509-47b1-b686-ecdf32e30a05 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:29.910134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e70567c-7509-47b1-b686-ecdf32e30a05 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:30.039990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8e70567c-7509-47b1-b686-ecdf32e30a05 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:30.048122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8e70567c-7509-47b1-b686-ecdf32e30a05 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.150268 Jun 20 06:13:30.049024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 138/295] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:29 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:30.470224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c120d137-71e1-4034-92a4-cc559cf60450 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:30.470824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c120d137-71e1-4034-92a4-cc559cf60450 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:30.477320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c120d137-71e1-4034-92a4-cc559cf60450 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:30.477798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c120d137-71e1-4034-92a4-cc559cf60450 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:30.478656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c120d137-71e1-4034-92a4-cc559cf60450 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:30.479081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c120d137-71e1-4034-92a4-cc559cf60450 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:30.608594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c120d137-71e1-4034-92a4-cc559cf60450 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:30.616016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c120d137-71e1-4034-92a4-cc559cf60450 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.149560 Jun 20 06:13:30.616807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 158/296] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:30 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:31.065827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3fd9f366-ed00-4153-8216-33028108a91c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:31.066436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3fd9f366-ed00-4153-8216-33028108a91c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:31.073465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fd9f366-ed00-4153-8216-33028108a91c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:31.073932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fd9f366-ed00-4153-8216-33028108a91c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:31.074702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fd9f366-ed00-4153-8216-33028108a91c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:31.075135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fd9f366-ed00-4153-8216-33028108a91c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:31.216734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3fd9f366-ed00-4153-8216-33028108a91c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:31.224132 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3fd9f366-ed00-4153-8216-33028108a91c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.162251 Jun 20 06:13:31.224690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 139/297] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:31 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:31.632559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-15f6edc9-e82c-4cbb-96f4-d4621b18cf0b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:31.633528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-15f6edc9-e82c-4cbb-96f4-d4621b18cf0b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:31.639574 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-15f6edc9-e82c-4cbb-96f4-d4621b18cf0b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:31.640028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-15f6edc9-e82c-4cbb-96f4-d4621b18cf0b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:31.640791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-15f6edc9-e82c-4cbb-96f4-d4621b18cf0b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:31.641227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-15f6edc9-e82c-4cbb-96f4-d4621b18cf0b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:31.770484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-15f6edc9-e82c-4cbb-96f4-d4621b18cf0b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:31.777992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-15f6edc9-e82c-4cbb-96f4-d4621b18cf0b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.149920 Jun 20 06:13:31.778664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 159/298] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:31 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:32.239975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0a435f90-03fb-488f-8ce3-437fd73f8945 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:32.240609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0a435f90-03fb-488f-8ce3-437fd73f8945 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:32.247118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a435f90-03fb-488f-8ce3-437fd73f8945 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.247545 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a435f90-03fb-488f-8ce3-437fd73f8945 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.248289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a435f90-03fb-488f-8ce3-437fd73f8945 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.248717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a435f90-03fb-488f-8ce3-437fd73f8945 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.378676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0a435f90-03fb-488f-8ce3-437fd73f8945 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:32.386928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0a435f90-03fb-488f-8ce3-437fd73f8945 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.150873 Jun 20 06:13:32.387486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 140/299] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:32 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:32.795052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b8564ddc-c932-4e06-a3b6-bf53addd8fae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:32.795665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b8564ddc-c932-4e06-a3b6-bf53addd8fae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:32.801694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8564ddc-c932-4e06-a3b6-bf53addd8fae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.802143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8564ddc-c932-4e06-a3b6-bf53addd8fae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.802904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8564ddc-c932-4e06-a3b6-bf53addd8fae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.803343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8564ddc-c932-4e06-a3b6-bf53addd8fae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.929450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b8564ddc-c932-4e06-a3b6-bf53addd8fae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:32.937028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b8564ddc-c932-4e06-a3b6-bf53addd8fae tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.145821 Jun 20 06:13:32.937615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 160/300] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:32 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:33.404468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-634cd0ef-ca19-4ed2-9494-000ef3a3a32c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:33.405070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-634cd0ef-ca19-4ed2-9494-000ef3a3a32c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:33.411741 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-634cd0ef-ca19-4ed2-9494-000ef3a3a32c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:33.412183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-634cd0ef-ca19-4ed2-9494-000ef3a3a32c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:33.412933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-634cd0ef-ca19-4ed2-9494-000ef3a3a32c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:33.413358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-634cd0ef-ca19-4ed2-9494-000ef3a3a32c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:33.417192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:33.542383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-634cd0ef-ca19-4ed2-9494-000ef3a3a32c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:33.550508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-634cd0ef-ca19-4ed2-9494-000ef3a3a32c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.149869 Jun 20 06:13:33.551074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 141/301] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:33 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:33.953229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45b4cdd5-3d06-412c-97b0-39a5c1538e7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:33.953789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-45b4cdd5-3d06-412c-97b0-39a5c1538e7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:33.959682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45b4cdd5-3d06-412c-97b0-39a5c1538e7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:33.960126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45b4cdd5-3d06-412c-97b0-39a5c1538e7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:33.961007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45b4cdd5-3d06-412c-97b0-39a5c1538e7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:33.961655 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45b4cdd5-3d06-412c-97b0-39a5c1538e7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:34.091283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-45b4cdd5-3d06-412c-97b0-39a5c1538e7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:34.098669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-45b4cdd5-3d06-412c-97b0-39a5c1538e7c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.149345 Jun 20 06:13:34.099213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 161/302] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:33 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:34.567905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d64b8961-4d1d-4ab0-8271-177c79ff6aa9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:34.568445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d64b8961-4d1d-4ab0-8271-177c79ff6aa9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:34.574970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d64b8961-4d1d-4ab0-8271-177c79ff6aa9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:34.575418 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d64b8961-4d1d-4ab0-8271-177c79ff6aa9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:34.576179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d64b8961-4d1d-4ab0-8271-177c79ff6aa9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:34.576611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d64b8961-4d1d-4ab0-8271-177c79ff6aa9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:34.704447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d64b8961-4d1d-4ab0-8271-177c79ff6aa9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:34.711847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d64b8961-4d1d-4ab0-8271-177c79ff6aa9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.147890 Jun 20 06:13:34.712390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 142/303] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:34 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:35.115446 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-96869b2b-5777-43ac-a19d-3b8d1c5a24b1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:35.115981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-96869b2b-5777-43ac-a19d-3b8d1c5a24b1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:35.122075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96869b2b-5777-43ac-a19d-3b8d1c5a24b1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:35.122516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96869b2b-5777-43ac-a19d-3b8d1c5a24b1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:35.123269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96869b2b-5777-43ac-a19d-3b8d1c5a24b1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:35.123696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96869b2b-5777-43ac-a19d-3b8d1c5a24b1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:35.257404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-96869b2b-5777-43ac-a19d-3b8d1c5a24b1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:35.265226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-96869b2b-5777-43ac-a19d-3b8d1c5a24b1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.153566 Jun 20 06:13:35.265823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 162/304] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:35 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:35.727764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5ceceebe-5df4-46ba-8a0c-c252923a89b5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:35.728376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5ceceebe-5df4-46ba-8a0c-c252923a89b5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:35.734871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ceceebe-5df4-46ba-8a0c-c252923a89b5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:35.735305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ceceebe-5df4-46ba-8a0c-c252923a89b5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:35.736066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ceceebe-5df4-46ba-8a0c-c252923a89b5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:35.736508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ceceebe-5df4-46ba-8a0c-c252923a89b5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:35.868973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5ceceebe-5df4-46ba-8a0c-c252923a89b5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:35.876235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5ceceebe-5df4-46ba-8a0c-c252923a89b5 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.152205 Jun 20 06:13:35.876798 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 143/305] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:35 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:36.282335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-663697d1-531b-4d7b-b1d5-8800ede2b469 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:36.282907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-663697d1-531b-4d7b-b1d5-8800ede2b469 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:36.291355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-663697d1-531b-4d7b-b1d5-8800ede2b469 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:36.291789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-663697d1-531b-4d7b-b1d5-8800ede2b469 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:36.292549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-663697d1-531b-4d7b-b1d5-8800ede2b469 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:36.293099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-663697d1-531b-4d7b-b1d5-8800ede2b469 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:36.429607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-663697d1-531b-4d7b-b1d5-8800ede2b469 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:36.437556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-663697d1-531b-4d7b-b1d5-8800ede2b469 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.159453 Jun 20 06:13:36.438103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 163/306] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:36 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:36.893567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ba224254-2916-4df2-9ddc-d53964cecd0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:36.894170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ba224254-2916-4df2-9ddc-d53964cecd0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:36.901540 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba224254-2916-4df2-9ddc-d53964cecd0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:36.901984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba224254-2916-4df2-9ddc-d53964cecd0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:36.902734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba224254-2916-4df2-9ddc-d53964cecd0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:36.903216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba224254-2916-4df2-9ddc-d53964cecd0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:37.032184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ba224254-2916-4df2-9ddc-d53964cecd0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:37.039533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ba224254-2916-4df2-9ddc-d53964cecd0f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.149920 Jun 20 06:13:37.040095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 144/307] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:36 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:37.454420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6bef0802-2ac4-4980-bf14-15bddab82c8b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:37.455029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6bef0802-2ac4-4980-bf14-15bddab82c8b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:37.461399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bef0802-2ac4-4980-bf14-15bddab82c8b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:37.461864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bef0802-2ac4-4980-bf14-15bddab82c8b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:37.462620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bef0802-2ac4-4980-bf14-15bddab82c8b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:37.463050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bef0802-2ac4-4980-bf14-15bddab82c8b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:37.588307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6bef0802-2ac4-4980-bf14-15bddab82c8b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:37.595595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6bef0802-2ac4-4980-bf14-15bddab82c8b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.144960 Jun 20 06:13:37.596149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 164/308] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:37 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:37.938500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-668b6a8c-3326-44b5-bbce-4f58a6f33441 req-3d5a4421-9f6c-4a6d-b88b-34b9a3ec64f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8", "name": "network-vif-plugged", "status": "completed", "tag": "5a72e255-8fb2-4aae-96a9-72709143f912"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:37.948158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-668b6a8c-3326-44b5-bbce-4f58a6f33441 req-3d5a4421-9f6c-4a6d-b88b-34b9a3ec64f4 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:37.948694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-668b6a8c-3326-44b5-bbce-4f58a6f33441 req-3d5a4421-9f6c-4a6d-b88b-34b9a3ec64f4 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:37.960006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-668b6a8c-3326-44b5-bbce-4f58a6f33441 req-3d5a4421-9f6c-4a6d-b88b-34b9a3ec64f4 service nova] Creating event network-vif-plugged:5a72e255-8fb2-4aae-96a9-72709143f912 for instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 on hv-cinder-80473 Jun 20 06:13:37.965955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-668b6a8c-3326-44b5-bbce-4f58a6f33441 req-3d5a4421-9f6c-4a6d-b88b-34b9a3ec64f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031724 Jun 20 06:13:37.966654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 145/309] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:38.055891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c4ab260d-af31-4957-a134-46c0c6323bc0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:38.056498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c4ab260d-af31-4957-a134-46c0c6323bc0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:38.062395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4ab260d-af31-4957-a134-46c0c6323bc0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:38.062830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4ab260d-af31-4957-a134-46c0c6323bc0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:38.063572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4ab260d-af31-4957-a134-46c0c6323bc0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:38.064002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4ab260d-af31-4957-a134-46c0c6323bc0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:38.199861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c4ab260d-af31-4957-a134-46c0c6323bc0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:38.207905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c4ab260d-af31-4957-a134-46c0c6323bc0 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.155846 Jun 20 06:13:38.208464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 165/310] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:38 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:38.613853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ceb90cea-61d2-4504-ad4f-6247aa883a04 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:38.614560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ceb90cea-61d2-4504-ad4f-6247aa883a04 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:38.621027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb90cea-61d2-4504-ad4f-6247aa883a04 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:38.621510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb90cea-61d2-4504-ad4f-6247aa883a04 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:38.622272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb90cea-61d2-4504-ad4f-6247aa883a04 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:38.622704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb90cea-61d2-4504-ad4f-6247aa883a04 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:38.800444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ceb90cea-61d2-4504-ad4f-6247aa883a04 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:38.808683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ceb90cea-61d2-4504-ad4f-6247aa883a04 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.199018 Jun 20 06:13:38.809256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 146/311] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:38 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:39.225235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-18c6de22-5370-4e2b-a833-ef40756e41ae tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:39.225798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-18c6de22-5370-4e2b-a833-ef40756e41ae tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:39.232194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18c6de22-5370-4e2b-a833-ef40756e41ae tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:39.232636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18c6de22-5370-4e2b-a833-ef40756e41ae tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:39.233398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18c6de22-5370-4e2b-a833-ef40756e41ae tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:39.233825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18c6de22-5370-4e2b-a833-ef40756e41ae tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:39.362529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-18c6de22-5370-4e2b-a833-ef40756e41ae tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:39.370571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-18c6de22-5370-4e2b-a833-ef40756e41ae tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.149331 Jun 20 06:13:39.371144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 166/312] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:39 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:39.827148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4d29aa09-6789-4046-bad5-4b4318e79b3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:39.827754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4d29aa09-6789-4046-bad5-4b4318e79b3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:39.834146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d29aa09-6789-4046-bad5-4b4318e79b3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:39.834593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d29aa09-6789-4046-bad5-4b4318e79b3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:39.835342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d29aa09-6789-4046-bad5-4b4318e79b3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:39.836467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4d29aa09-6789-4046-bad5-4b4318e79b3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:39.964783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4d29aa09-6789-4046-bad5-4b4318e79b3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:39.972484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4d29aa09-6789-4046-bad5-4b4318e79b3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.149147 Jun 20 06:13:39.973047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 147/313] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:39 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:40.387575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4b4324b4-8dc0-4ec6-8c83-b9aebdc16326 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:40.388167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4b4324b4-8dc0-4ec6-8c83-b9aebdc16326 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:40.394070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b4324b4-8dc0-4ec6-8c83-b9aebdc16326 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:40.394508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b4324b4-8dc0-4ec6-8c83-b9aebdc16326 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:40.395510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b4324b4-8dc0-4ec6-8c83-b9aebdc16326 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:40.395937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b4324b4-8dc0-4ec6-8c83-b9aebdc16326 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:40.531003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4b4324b4-8dc0-4ec6-8c83-b9aebdc16326 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:40.538431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4b4324b4-8dc0-4ec6-8c83-b9aebdc16326 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.155622 Jun 20 06:13:40.538986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 167/314] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:40 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:40.989179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0c8a5799-c962-47ad-a305-505271dede0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:40.989808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0c8a5799-c962-47ad-a305-505271dede0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:40.996510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c8a5799-c962-47ad-a305-505271dede0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:40.996957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c8a5799-c962-47ad-a305-505271dede0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:40.997738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c8a5799-c962-47ad-a305-505271dede0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:40.998169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c8a5799-c962-47ad-a305-505271dede0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:41.124295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0c8a5799-c962-47ad-a305-505271dede0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:41.131584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0c8a5799-c962-47ad-a305-505271dede0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.146245 Jun 20 06:13:41.132139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 148/315] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:40 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:41.556297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2699e39d-b0ea-4b09-91d2-05fdca0950a2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:41.557119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2699e39d-b0ea-4b09-91d2-05fdca0950a2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:41.563190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2699e39d-b0ea-4b09-91d2-05fdca0950a2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:41.563638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2699e39d-b0ea-4b09-91d2-05fdca0950a2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:41.564401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2699e39d-b0ea-4b09-91d2-05fdca0950a2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:41.564834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2699e39d-b0ea-4b09-91d2-05fdca0950a2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:41.698944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2699e39d-b0ea-4b09-91d2-05fdca0950a2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:41.706313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2699e39d-b0ea-4b09-91d2-05fdca0950a2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.154500 Jun 20 06:13:41.706865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 168/316] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:41 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:42.148478 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ec341c50-b8ba-403f-b083-4e367a3bebec tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:42.149082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec341c50-b8ba-403f-b083-4e367a3bebec tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:42.155537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec341c50-b8ba-403f-b083-4e367a3bebec tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:42.155981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec341c50-b8ba-403f-b083-4e367a3bebec tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:42.156731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec341c50-b8ba-403f-b083-4e367a3bebec tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:42.157159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec341c50-b8ba-403f-b083-4e367a3bebec tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:42.285732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ec341c50-b8ba-403f-b083-4e367a3bebec tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:42.294291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ec341c50-b8ba-403f-b083-4e367a3bebec tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.149829 Jun 20 06:13:42.294866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 149/317] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:42 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:42.724118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c44124cd-aec4-4c14-9a1e-6c38c394e29c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:42.724764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c44124cd-aec4-4c14-9a1e-6c38c394e29c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:42.731077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c44124cd-aec4-4c14-9a1e-6c38c394e29c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:42.731524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c44124cd-aec4-4c14-9a1e-6c38c394e29c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:42.732272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c44124cd-aec4-4c14-9a1e-6c38c394e29c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:42.732702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c44124cd-aec4-4c14-9a1e-6c38c394e29c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:42.863370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c44124cd-aec4-4c14-9a1e-6c38c394e29c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:42.871500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c44124cd-aec4-4c14-9a1e-6c38c394e29c tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.151263 Jun 20 06:13:42.872045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 169/318] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:42 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:43.311608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6770d1f7-f5a7-4a53-ae5d-4a6329543033 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:43.312254 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6770d1f7-f5a7-4a53-ae5d-4a6329543033 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:43.318779 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6770d1f7-f5a7-4a53-ae5d-4a6329543033 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:43.319230 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6770d1f7-f5a7-4a53-ae5d-4a6329543033 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:43.319995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6770d1f7-f5a7-4a53-ae5d-4a6329543033 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:43.320431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6770d1f7-f5a7-4a53-ae5d-4a6329543033 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:43.450235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6770d1f7-f5a7-4a53-ae5d-4a6329543033 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:43.457573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6770d1f7-f5a7-4a53-ae5d-4a6329543033 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.150232 Jun 20 06:13:43.458140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 150/319] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:43 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:43.888549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-aba9825b-0ad9-4053-9c44-acbe5be0f2f6 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:43.889156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-aba9825b-0ad9-4053-9c44-acbe5be0f2f6 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:43.895323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aba9825b-0ad9-4053-9c44-acbe5be0f2f6 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:43.895762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aba9825b-0ad9-4053-9c44-acbe5be0f2f6 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:43.896507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aba9825b-0ad9-4053-9c44-acbe5be0f2f6 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:43.896935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aba9825b-0ad9-4053-9c44-acbe5be0f2f6 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:44.029967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-aba9825b-0ad9-4053-9c44-acbe5be0f2f6 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:44.037286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-aba9825b-0ad9-4053-9c44-acbe5be0f2f6 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.152588 Jun 20 06:13:44.037868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 170/320] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:43 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:44.475362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e42f0371-e5ce-4dc5-a5ee-f4b3939e363b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:44.475965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e42f0371-e5ce-4dc5-a5ee-f4b3939e363b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:44.483214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e42f0371-e5ce-4dc5-a5ee-f4b3939e363b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:44.483660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e42f0371-e5ce-4dc5-a5ee-f4b3939e363b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:44.484482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e42f0371-e5ce-4dc5-a5ee-f4b3939e363b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:44.484971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e42f0371-e5ce-4dc5-a5ee-f4b3939e363b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:44.622249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e42f0371-e5ce-4dc5-a5ee-f4b3939e363b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:44.629636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e42f0371-e5ce-4dc5-a5ee-f4b3939e363b tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.158182 Jun 20 06:13:44.630195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 151/321] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:44 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:45.053903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-28a2a433-f068-4124-936f-dda9a2ece00b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:45.054525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-28a2a433-f068-4124-936f-dda9a2ece00b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:45.060437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28a2a433-f068-4124-936f-dda9a2ece00b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:45.060877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28a2a433-f068-4124-936f-dda9a2ece00b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:45.061664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28a2a433-f068-4124-936f-dda9a2ece00b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:45.062103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28a2a433-f068-4124-936f-dda9a2ece00b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:45.192549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-28a2a433-f068-4124-936f-dda9a2ece00b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:45.201252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-28a2a433-f068-4124-936f-dda9a2ece00b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.151161 Jun 20 06:13:45.204155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 171/322] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:45 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:45.647365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9046ba59-a9b7-47a8-bb73-19f8330e0b2e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:45.647971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9046ba59-a9b7-47a8-bb73-19f8330e0b2e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:45.654463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9046ba59-a9b7-47a8-bb73-19f8330e0b2e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:45.654902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9046ba59-a9b7-47a8-bb73-19f8330e0b2e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:45.655651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9046ba59-a9b7-47a8-bb73-19f8330e0b2e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:45.656079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9046ba59-a9b7-47a8-bb73-19f8330e0b2e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:45.796447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9046ba59-a9b7-47a8-bb73-19f8330e0b2e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:45.803879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9046ba59-a9b7-47a8-bb73-19f8330e0b2e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.160584 Jun 20 06:13:45.804443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 152/323] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:45 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:46.220808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2782fc2b-c92a-40d6-aa10-a3d524d55ece tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:46.221412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2782fc2b-c92a-40d6-aa10-a3d524d55ece tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:46.227264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2782fc2b-c92a-40d6-aa10-a3d524d55ece tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:46.228370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2782fc2b-c92a-40d6-aa10-a3d524d55ece tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:46.229113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2782fc2b-c92a-40d6-aa10-a3d524d55ece tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:46.229577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2782fc2b-c92a-40d6-aa10-a3d524d55ece tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:46.358034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2782fc2b-c92a-40d6-aa10-a3d524d55ece tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:46.365455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2782fc2b-c92a-40d6-aa10-a3d524d55ece tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.148369 Jun 20 06:13:46.365961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 172/324] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:46 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:46.823111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-130036a8-f881-468e-b286-2c73687b3c53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:46.823726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-130036a8-f881-468e-b286-2c73687b3c53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:46.830704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-130036a8-f881-468e-b286-2c73687b3c53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:46.831177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-130036a8-f881-468e-b286-2c73687b3c53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:46.831935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-130036a8-f881-468e-b286-2c73687b3c53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:46.832369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-130036a8-f881-468e-b286-2c73687b3c53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:46.965505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-130036a8-f881-468e-b286-2c73687b3c53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:46.972893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-130036a8-f881-468e-b286-2c73687b3c53 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.155104 Jun 20 06:13:46.973687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 153/325] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:46 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:47.382200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ae4610d7-7fd5-42a4-9a7d-2999386b0d1e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:47.382820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ae4610d7-7fd5-42a4-9a7d-2999386b0d1e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:47.388781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae4610d7-7fd5-42a4-9a7d-2999386b0d1e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:47.389232 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae4610d7-7fd5-42a4-9a7d-2999386b0d1e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:47.390100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae4610d7-7fd5-42a4-9a7d-2999386b0d1e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:47.390535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae4610d7-7fd5-42a4-9a7d-2999386b0d1e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:47.394479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:47.531166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ae4610d7-7fd5-42a4-9a7d-2999386b0d1e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:47.538555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ae4610d7-7fd5-42a4-9a7d-2999386b0d1e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.160187 Jun 20 06:13:47.539115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 173/326] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:47 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:47.989818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-66150a21-826a-425d-a20a-df7695067bb9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:47.990543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-66150a21-826a-425d-a20a-df7695067bb9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:47.997170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66150a21-826a-425d-a20a-df7695067bb9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:47.997647 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66150a21-826a-425d-a20a-df7695067bb9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:47.998407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66150a21-826a-425d-a20a-df7695067bb9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:47.998843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66150a21-826a-425d-a20a-df7695067bb9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:48.125513 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-66150a21-826a-425d-a20a-df7695067bb9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:48.132905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-66150a21-826a-425d-a20a-df7695067bb9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.146934 Jun 20 06:13:48.133998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 154/327] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:47 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:48.555250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a4bb025a-b106-45d6-be11-ceaff80f6b54 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:48.556622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a4bb025a-b106-45d6-be11-ceaff80f6b54 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:48.558504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=54 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:48.563716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4bb025a-b106-45d6-be11-ceaff80f6b54 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:48.564166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4bb025a-b106-45d6-be11-ceaff80f6b54 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:48.564924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4bb025a-b106-45d6-be11-ceaff80f6b54 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:48.565358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4bb025a-b106-45d6-be11-ceaff80f6b54 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:48.694398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a4bb025a-b106-45d6-be11-ceaff80f6b54 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:48.702335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a4bb025a-b106-45d6-be11-ceaff80f6b54 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.150817 Jun 20 06:13:48.702900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 174/328] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:48 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:49.151151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-77e3e867-7a62-42b0-b256-f6c060a9d6aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:49.151754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-77e3e867-7a62-42b0-b256-f6c060a9d6aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:49.158223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77e3e867-7a62-42b0-b256-f6c060a9d6aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:49.158619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77e3e867-7a62-42b0-b256-f6c060a9d6aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:49.159377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77e3e867-7a62-42b0-b256-f6c060a9d6aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:49.159811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77e3e867-7a62-42b0-b256-f6c060a9d6aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:49.286904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-77e3e867-7a62-42b0-b256-f6c060a9d6aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:49.295103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-77e3e867-7a62-42b0-b256-f6c060a9d6aa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.148341 Jun 20 06:13:49.295701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 155/329] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:49 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:49.719097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6bfd93b2-4a3d-4650-989c-669a2de8c579 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:49.719638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6bfd93b2-4a3d-4650-989c-669a2de8c579 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:49.725629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bfd93b2-4a3d-4650-989c-669a2de8c579 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:49.726079 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bfd93b2-4a3d-4650-989c-669a2de8c579 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:49.726840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bfd93b2-4a3d-4650-989c-669a2de8c579 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:49.727349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bfd93b2-4a3d-4650-989c-669a2de8c579 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:49.857229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6bfd93b2-4a3d-4650-989c-669a2de8c579 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:49.866001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6bfd93b2-4a3d-4650-989c-669a2de8c579 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.150850 Jun 20 06:13:49.866565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 175/330] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:49 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:50.312415 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40aa993e-5021-472d-b2af-1c3c386eaa3f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:50.313026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40aa993e-5021-472d-b2af-1c3c386eaa3f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:50.315455 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=52 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:50.320709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40aa993e-5021-472d-b2af-1c3c386eaa3f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:50.321160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40aa993e-5021-472d-b2af-1c3c386eaa3f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:50.321954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40aa993e-5021-472d-b2af-1c3c386eaa3f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:50.322389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40aa993e-5021-472d-b2af-1c3c386eaa3f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:50.449794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40aa993e-5021-472d-b2af-1c3c386eaa3f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:50.457163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40aa993e-5021-472d-b2af-1c3c386eaa3f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.148647 Jun 20 06:13:50.457746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 156/331] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:50 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:50.884487 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-439b2f4b-dab7-4078-81dd-7b6b53c083b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:50.885102 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-439b2f4b-dab7-4078-81dd-7b6b53c083b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:50.891461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-439b2f4b-dab7-4078-81dd-7b6b53c083b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:50.891914 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-439b2f4b-dab7-4078-81dd-7b6b53c083b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:50.892677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-439b2f4b-dab7-4078-81dd-7b6b53c083b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:50.893109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-439b2f4b-dab7-4078-81dd-7b6b53c083b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:51.025716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-439b2f4b-dab7-4078-81dd-7b6b53c083b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:51.032965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-439b2f4b-dab7-4078-81dd-7b6b53c083b9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1314 microversion: 2.1 time: 0.152473 Jun 20 06:13:51.033543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 176/332] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:50 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:51.474117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6fc1d7bb-8382-477b-9648-d15f7f41b348 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:51.474752 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6fc1d7bb-8382-477b-9648-d15f7f41b348 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:51.481233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fc1d7bb-8382-477b-9648-d15f7f41b348 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:51.481745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fc1d7bb-8382-477b-9648-d15f7f41b348 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:51.482511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fc1d7bb-8382-477b-9648-d15f7f41b348 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:51.482950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6fc1d7bb-8382-477b-9648-d15f7f41b348 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:51.625174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6fc1d7bb-8382-477b-9648-d15f7f41b348 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:51.635019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6fc1d7bb-8382-477b-9648-d15f7f41b348 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.164699 Jun 20 06:13:51.644785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 157/333] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:51 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:52.052286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-10862ddd-db52-4bfe-8cf0-4b0f428d7280 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:52.053467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-10862ddd-db52-4bfe-8cf0-4b0f428d7280 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:52.064474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10862ddd-db52-4bfe-8cf0-4b0f428d7280 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.064969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10862ddd-db52-4bfe-8cf0-4b0f428d7280 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.065831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10862ddd-db52-4bfe-8cf0-4b0f428d7280 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.066308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10862ddd-db52-4bfe-8cf0-4b0f428d7280 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.195066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-10862ddd-db52-4bfe-8cf0-4b0f428d7280 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:52.203351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-10862ddd-db52-4bfe-8cf0-4b0f428d7280 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1498 microversion: 2.1 time: 0.157273 Jun 20 06:13:52.203921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 177/334] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:52 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:52.652677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-82e34b02-a4dd-4774-b11a-2345ebd54af4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:52.653288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-82e34b02-a4dd-4774-b11a-2345ebd54af4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:52.659884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82e34b02-a4dd-4774-b11a-2345ebd54af4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.660376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82e34b02-a4dd-4774-b11a-2345ebd54af4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.661157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82e34b02-a4dd-4774-b11a-2345ebd54af4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.661622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82e34b02-a4dd-4774-b11a-2345ebd54af4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.680470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:52.807672 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-82e34b02-a4dd-4774-b11a-2345ebd54af4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:52.819633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-82e34b02-a4dd-4774-b11a-2345ebd54af4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1502 microversion: 2.1 time: 0.171355 Jun 20 06:13:52.821942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 158/335] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:52 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:52.841127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c96b3e5a-c529-48b8-b99b-c81e54569379"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:52.844476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:52.852260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.852532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.853965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.854392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.885132 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] HTTP exception thrown: Cannot 'attach_volume' instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d while it is in vm_state rescued Jun 20 06:13:52.886987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-82b0824f-c4db-4ccb-8fa1-a7c0f46008f8 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Request method failure captured: Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: POST /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d/os-volume_attachments HTTP/1.1 Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 74 Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA-DER0TG_EM_kUuulCfSmaf9yvnYbEs_HSUaTrJaHJEUGAeVmc3ObCznlmOxH_83TrveBUV0DgjahoYMfkSeQpz3PDbaMeXgNR0mG3qwNqVtYM9gBT9zPehd8pj9OgXcyTcHyYvPalcO7ldwHo-KFRZP22X4GqW06N6olXwdZB2rwE Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:13:52.887215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}] Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: f49340b89c2a43b288572263ddac7be8 Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {"volumeAttachment": {"volumeId": "c96b3e5a-c529-48b8-b99b-c81e54569379"}} Jun 20 06:13:52.888798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Cannot 'attach_volume' instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d while it is in vm_state rescued Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'server_id': '50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d', 'body': {'volumeAttachment': {'volumeId': 'c96b3e5a-c529-48b8-b99b-c81e54569379'}}} Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:52.889737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d while it is in vm_state rescued Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:52.891133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:52.892758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:52.892758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:52.892758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d while it is in vm_state rescued Jun 20 06:13:52.892758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:13:52.892758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Returning 409 to user: Cannot 'attach_volume' instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d while it is in vm_state rescued {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:52.892758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2cc6dcdb-256c-4117-8e0a-4431ca998904 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053791 Jun 20 06:13:52.893597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-82b0824f-c4db-4ccb-8fa1-a7c0f46008f8 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:52.893749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 178/336] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:13:52 2022] POST /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 06:13:52.900162 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82b0824f-c4db-4ccb-8fa1-a7c0f46008f8 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.900646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82b0824f-c4db-4ccb-8fa1-a7c0f46008f8 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.901109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2e88fb4d-a231-4f5d-a3a5-0c27b3fd5187 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:52.901556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82b0824f-c4db-4ccb-8fa1-a7c0f46008f8 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.902977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2e88fb4d-a231-4f5d-a3a5-0c27b3fd5187 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:52.903084 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82b0824f-c4db-4ccb-8fa1-a7c0f46008f8 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.910517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e88fb4d-a231-4f5d-a3a5-0c27b3fd5187 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.911100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e88fb4d-a231-4f5d-a3a5-0c27b3fd5187 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.912049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e88fb4d-a231-4f5d-a3a5-0c27b3fd5187 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:52.912575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e88fb4d-a231-4f5d-a3a5-0c27b3fd5187 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.933809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-82b0824f-c4db-4ccb-8fa1-a7c0f46008f8 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:13:52.987941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2e88fb4d-a231-4f5d-a3a5-0c27b3fd5187 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.093380 Jun 20 06:13:52.991904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 179/337] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:13:52 2022] POST /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:13:52.999797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d9e6c899-19b4-4c4b-a488-aa1cc69fafed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:53.000626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d9e6c899-19b4-4c4b-a488-aa1cc69fafed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:53.010267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9e6c899-19b4-4c4b-a488-aa1cc69fafed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:53.011041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9e6c899-19b4-4c4b-a488-aa1cc69fafed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:53.011842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9e6c899-19b4-4c4b-a488-aa1cc69fafed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:53.012304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9e6c899-19b4-4c4b-a488-aa1cc69fafed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:53.033860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-82b0824f-c4db-4ccb-8fa1-a7c0f46008f8 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "DELETE /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 204 len: 0 microversion: 2.1 time: 0.151142 Jun 20 06:13:53.034781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 159/338] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:13:52 2022] DELETE /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:13:53.044200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ada93655-ad5d-4040-88ee-5d4d1b3c9220 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:53.045174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ada93655-ad5d-4040-88ee-5d4d1b3c9220 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:53.058457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ada93655-ad5d-4040-88ee-5d4d1b3c9220 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:53.058931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ada93655-ad5d-4040-88ee-5d4d1b3c9220 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:53.059710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ada93655-ad5d-4040-88ee-5d4d1b3c9220 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:53.060141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ada93655-ad5d-4040-88ee-5d4d1b3c9220 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:53.219469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d9e6c899-19b4-4c4b-a488-aa1cc69fafed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:53.229191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d9e6c899-19b4-4c4b-a488-aa1cc69fafed tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.235668 Jun 20 06:13:53.229872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 180/339] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:52 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:53.241905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ada93655-ad5d-4040-88ee-5d4d1b3c9220 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:53.249999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ada93655-ad5d-4040-88ee-5d4d1b3c9220 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1504 microversion: 2.1 time: 0.211046 Jun 20 06:13:53.250564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 160/340] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:53 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:54.246354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bc54dad4-aa56-49c9-a9f4-e5bda18986e1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:54.247222 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bc54dad4-aa56-49c9-a9f4-e5bda18986e1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:54.255730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc54dad4-aa56-49c9-a9f4-e5bda18986e1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:54.256295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc54dad4-aa56-49c9-a9f4-e5bda18986e1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:54.257317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc54dad4-aa56-49c9-a9f4-e5bda18986e1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:54.257871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc54dad4-aa56-49c9-a9f4-e5bda18986e1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:54.268179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0e10d4fe-c418-41c5-b6c8-19522539927f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:54.268547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0e10d4fe-c418-41c5-b6c8-19522539927f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:54.281303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e10d4fe-c418-41c5-b6c8-19522539927f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:54.281783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e10d4fe-c418-41c5-b6c8-19522539927f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:54.282554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e10d4fe-c418-41c5-b6c8-19522539927f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:54.282992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e10d4fe-c418-41c5-b6c8-19522539927f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:54.469992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bc54dad4-aa56-49c9-a9f4-e5bda18986e1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:54.474019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0e10d4fe-c418-41c5-b6c8-19522539927f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:54.477730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bc54dad4-aa56-49c9-a9f4-e5bda18986e1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.235112 Jun 20 06:13:54.478694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 181/341] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:54 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:54.481883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0e10d4fe-c418-41c5-b6c8-19522539927f tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1504 microversion: 2.1 time: 0.217731 Jun 20 06:13:54.482440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 161/342] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:54 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:55.495153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-943387d9-96ab-4c9b-a3c7-7d0086a6200c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:55.495764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-943387d9-96ab-4c9b-a3c7-7d0086a6200c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:55.498464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-64d4790d-ef04-4e2d-93fc-d173e8f5b862 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:55.499077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-64d4790d-ef04-4e2d-93fc-d173e8f5b862 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:55.501933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-943387d9-96ab-4c9b-a3c7-7d0086a6200c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.502386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-943387d9-96ab-4c9b-a3c7-7d0086a6200c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.503155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-943387d9-96ab-4c9b-a3c7-7d0086a6200c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.503598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-943387d9-96ab-4c9b-a3c7-7d0086a6200c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.505530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64d4790d-ef04-4e2d-93fc-d173e8f5b862 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.505984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64d4790d-ef04-4e2d-93fc-d173e8f5b862 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.506746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64d4790d-ef04-4e2d-93fc-d173e8f5b862 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.507182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64d4790d-ef04-4e2d-93fc-d173e8f5b862 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.695754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-943387d9-96ab-4c9b-a3c7-7d0086a6200c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:55.699430 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-64d4790d-ef04-4e2d-93fc-d173e8f5b862 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:55.703739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-943387d9-96ab-4c9b-a3c7-7d0086a6200c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.212377 Jun 20 06:13:55.704427 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 182/343] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:55 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:55.707033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-64d4790d-ef04-4e2d-93fc-d173e8f5b862 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1504 microversion: 2.1 time: 0.212284 Jun 20 06:13:55.707592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 162/344] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:55 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:56.721439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-64711a42-4f79-441f-9758-08fb93214ffb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:56.721969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-64711a42-4f79-441f-9758-08fb93214ffb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:56.723659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8fcdce6f-b21b-4e9a-9b01-1886a49b65c7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:56.724265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8fcdce6f-b21b-4e9a-9b01-1886a49b65c7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:56.728873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64711a42-4f79-441f-9758-08fb93214ffb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:56.729313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64711a42-4f79-441f-9758-08fb93214ffb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:56.730098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64711a42-4f79-441f-9758-08fb93214ffb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:56.730529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64711a42-4f79-441f-9758-08fb93214ffb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:56.731340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fcdce6f-b21b-4e9a-9b01-1886a49b65c7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:56.731790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fcdce6f-b21b-4e9a-9b01-1886a49b65c7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:56.732552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fcdce6f-b21b-4e9a-9b01-1886a49b65c7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:56.732987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fcdce6f-b21b-4e9a-9b01-1886a49b65c7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:56.919733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-64711a42-4f79-441f-9758-08fb93214ffb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:56.922888 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8fcdce6f-b21b-4e9a-9b01-1886a49b65c7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:56.927182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-64711a42-4f79-441f-9758-08fb93214ffb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.209699 Jun 20 06:13:56.927827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 183/345] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:56 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:56.930344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8fcdce6f-b21b-4e9a-9b01-1886a49b65c7 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1504 microversion: 2.1 time: 0.210431 Jun 20 06:13:56.931405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 163/346] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:56 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:57.944294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-429fcb06-02db-49c7-bbc2-03ac854cd64c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:57.944903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-429fcb06-02db-49c7-bbc2-03ac854cd64c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:57.948062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9e8ba8ea-3694-489c-a83c-35e06aa1a681 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:57.948705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9e8ba8ea-3694-489c-a83c-35e06aa1a681 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:57.951590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-429fcb06-02db-49c7-bbc2-03ac854cd64c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.952099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-429fcb06-02db-49c7-bbc2-03ac854cd64c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.952866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-429fcb06-02db-49c7-bbc2-03ac854cd64c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.953298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-429fcb06-02db-49c7-bbc2-03ac854cd64c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.955178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e8ba8ea-3694-489c-a83c-35e06aa1a681 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.955631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e8ba8ea-3694-489c-a83c-35e06aa1a681 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.956405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e8ba8ea-3694-489c-a83c-35e06aa1a681 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.956843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e8ba8ea-3694-489c-a83c-35e06aa1a681 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:58.162931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9e8ba8ea-3694-489c-a83c-35e06aa1a681 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:58.170404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9e8ba8ea-3694-489c-a83c-35e06aa1a681 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1504 microversion: 2.1 time: 0.226685 Jun 20 06:13:58.171167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 164/347] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:57 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:58.186954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-429fcb06-02db-49c7-bbc2-03ac854cd64c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:58.195046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-429fcb06-02db-49c7-bbc2-03ac854cd64c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.254744 Jun 20 06:13:58.195635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 184/348] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:57 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:59.187370 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3c01ca5c-0f06-4da7-ab5a-f93f0b0c902d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:59.187972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3c01ca5c-0f06-4da7-ab5a-f93f0b0c902d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:59.194608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c01ca5c-0f06-4da7-ab5a-f93f0b0c902d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:59.195053 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c01ca5c-0f06-4da7-ab5a-f93f0b0c902d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:59.195954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c01ca5c-0f06-4da7-ab5a-f93f0b0c902d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:59.196437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c01ca5c-0f06-4da7-ab5a-f93f0b0c902d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:59.214076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-361ae0cb-a78c-4e77-8d2b-51204e97eb2a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:59.214695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-361ae0cb-a78c-4e77-8d2b-51204e97eb2a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:59.220467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-361ae0cb-a78c-4e77-8d2b-51204e97eb2a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:59.220921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-361ae0cb-a78c-4e77-8d2b-51204e97eb2a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:59.221697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-361ae0cb-a78c-4e77-8d2b-51204e97eb2a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:59.222140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-361ae0cb-a78c-4e77-8d2b-51204e97eb2a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:59.430414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3c01ca5c-0f06-4da7-ab5a-f93f0b0c902d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:59.437986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3c01ca5c-0f06-4da7-ab5a-f93f0b0c902d tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1504 microversion: 2.1 time: 0.254555 Jun 20 06:13:59.438732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 165/349] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:59 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:59.460326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-361ae0cb-a78c-4e77-8d2b-51204e97eb2a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:59.468512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-361ae0cb-a78c-4e77-8d2b-51204e97eb2a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.259004 Jun 20 06:13:59.469082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 185/350] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:59 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:59.997533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-4bc5c502-f4d0-4b49-a3da-c1835bbc2ed5 req-11628440-1bce-4848-a0d6-eb30d1b63458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8", "name": "network-vif-deleted", "tag": "5a72e255-8fb2-4aae-96a9-72709143f912"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:00.005402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-4bc5c502-f4d0-4b49-a3da-c1835bbc2ed5 req-11628440-1bce-4848-a0d6-eb30d1b63458 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.006016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-4bc5c502-f4d0-4b49-a3da-c1835bbc2ed5 req-11628440-1bce-4848-a0d6-eb30d1b63458 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.017222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-4bc5c502-f4d0-4b49-a3da-c1835bbc2ed5 req-11628440-1bce-4848-a0d6-eb30d1b63458 service nova] Creating event network-vif-deleted:5a72e255-8fb2-4aae-96a9-72709143f912 for instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 on hv-cinder-80473 Jun 20 06:14:00.022427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-4bc5c502-f4d0-4b49-a3da-c1835bbc2ed5 req-11628440-1bce-4848-a0d6-eb30d1b63458 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029106 Jun 20 06:14:00.022991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 166/351] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:00.455925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e945a5ec-17af-4229-94cc-cbc67760258b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:00.456674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e945a5ec-17af-4229-94cc-cbc67760258b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:00.464227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e945a5ec-17af-4229-94cc-cbc67760258b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.464873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e945a5ec-17af-4229-94cc-cbc67760258b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.465658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e945a5ec-17af-4229-94cc-cbc67760258b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.466091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e945a5ec-17af-4229-94cc-cbc67760258b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.487918 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-76bc07d7-2133-4e0b-a5c7-c04dd72ac5eb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:00.489278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-76bc07d7-2133-4e0b-a5c7-c04dd72ac5eb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:00.497335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76bc07d7-2133-4e0b-a5c7-c04dd72ac5eb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.497702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76bc07d7-2133-4e0b-a5c7-c04dd72ac5eb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.498564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76bc07d7-2133-4e0b-a5c7-c04dd72ac5eb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.499229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76bc07d7-2133-4e0b-a5c7-c04dd72ac5eb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.542749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e945a5ec-17af-4229-94cc-cbc67760258b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:00.550787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e945a5ec-17af-4229-94cc-cbc67760258b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1462 microversion: 2.1 time: 0.099912 Jun 20 06:14:00.551635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 186/352] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:00 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1462 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:00.643883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76bc07d7-2133-4e0b-a5c7-c04dd72ac5eb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:00.652871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-76bc07d7-2133-4e0b-a5c7-c04dd72ac5eb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.169361 Jun 20 06:14:00.654023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 167/353] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:00 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:01.567507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a01dd76-b2d5-42f2-bda9-7888b7da7be2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:01.568380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8a01dd76-b2d5-42f2-bda9-7888b7da7be2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:01.575116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a01dd76-b2d5-42f2-bda9-7888b7da7be2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:01.575643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a01dd76-b2d5-42f2-bda9-7888b7da7be2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:01.576418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a01dd76-b2d5-42f2-bda9-7888b7da7be2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:01.576849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a01dd76-b2d5-42f2-bda9-7888b7da7be2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:01.653830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a01dd76-b2d5-42f2-bda9-7888b7da7be2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:01.661833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a01dd76-b2d5-42f2-bda9-7888b7da7be2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1462 microversion: 2.1 time: 0.098203 Jun 20 06:14:01.662494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 187/354] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:01 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:01.672082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-21be6783-aa59-41e5-ba95-b8e9fe1fd06e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:01.672751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-21be6783-aa59-41e5-ba95-b8e9fe1fd06e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:01.681122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21be6783-aa59-41e5-ba95-b8e9fe1fd06e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:01.681596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21be6783-aa59-41e5-ba95-b8e9fe1fd06e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:01.682695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21be6783-aa59-41e5-ba95-b8e9fe1fd06e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:01.683191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21be6783-aa59-41e5-ba95-b8e9fe1fd06e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:01.833194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-21be6783-aa59-41e5-ba95-b8e9fe1fd06e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:01.842636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-21be6783-aa59-41e5-ba95-b8e9fe1fd06e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.174487 Jun 20 06:14:01.843221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 168/355] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:01 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:02.683864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c4544374-becd-4a22-9fc6-44546431b2ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:02.684470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c4544374-becd-4a22-9fc6-44546431b2ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:02.690590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4544374-becd-4a22-9fc6-44546431b2ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:02.691036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4544374-becd-4a22-9fc6-44546431b2ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:02.691793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4544374-becd-4a22-9fc6-44546431b2ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:02.692226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4544374-becd-4a22-9fc6-44546431b2ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:02.753683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c4544374-becd-4a22-9fc6-44546431b2ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:02.761152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c4544374-becd-4a22-9fc6-44546431b2ef tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1462 microversion: 2.1 time: 0.081705 Jun 20 06:14:02.761738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 188/356] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:02 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:02.859558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1146bfcd-d7f0-4bfb-8af8-10ae110c3ac5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:02.860210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1146bfcd-d7f0-4bfb-8af8-10ae110c3ac5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:02.866603 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1146bfcd-d7f0-4bfb-8af8-10ae110c3ac5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:02.867063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1146bfcd-d7f0-4bfb-8af8-10ae110c3ac5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:02.867833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1146bfcd-d7f0-4bfb-8af8-10ae110c3ac5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:02.868376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1146bfcd-d7f0-4bfb-8af8-10ae110c3ac5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:02.998254 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1146bfcd-d7f0-4bfb-8af8-10ae110c3ac5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:03.005616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1146bfcd-d7f0-4bfb-8af8-10ae110c3ac5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.149874 Jun 20 06:14:03.006196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 169/357] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:02 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:03.777337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e91aa30f-c42e-4ecf-95a3-7310106c3dc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:03.777973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e91aa30f-c42e-4ecf-95a3-7310106c3dc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:03.784152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e91aa30f-c42e-4ecf-95a3-7310106c3dc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:03.784596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e91aa30f-c42e-4ecf-95a3-7310106c3dc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:03.785372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e91aa30f-c42e-4ecf-95a3-7310106c3dc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:03.785839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e91aa30f-c42e-4ecf-95a3-7310106c3dc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:03.790455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:03.847678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e91aa30f-c42e-4ecf-95a3-7310106c3dc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:03.855644 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e91aa30f-c42e-4ecf-95a3-7310106c3dc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1462 microversion: 2.1 time: 0.082166 Jun 20 06:14:03.856205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 189/358] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:03 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:04.022955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-931dd090-e07b-46f8-b5c7-7d6da2ec40e3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:04.023569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-931dd090-e07b-46f8-b5c7-7d6da2ec40e3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:04.030261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-931dd090-e07b-46f8-b5c7-7d6da2ec40e3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:04.030651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-931dd090-e07b-46f8-b5c7-7d6da2ec40e3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:04.031420 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-931dd090-e07b-46f8-b5c7-7d6da2ec40e3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:04.031858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-931dd090-e07b-46f8-b5c7-7d6da2ec40e3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:04.167544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-931dd090-e07b-46f8-b5c7-7d6da2ec40e3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:04.174920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-931dd090-e07b-46f8-b5c7-7d6da2ec40e3 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.156030 Jun 20 06:14:04.175475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 170/359] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:04 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:04.872511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ecfef589-2ca3-4b21-bcd1-0cae319a5330 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:04.873830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ecfef589-2ca3-4b21-bcd1-0cae319a5330 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:04.879808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ecfef589-2ca3-4b21-bcd1-0cae319a5330 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:04.880248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ecfef589-2ca3-4b21-bcd1-0cae319a5330 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:04.881004 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ecfef589-2ca3-4b21-bcd1-0cae319a5330 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:04.881465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ecfef589-2ca3-4b21-bcd1-0cae319a5330 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:04.944565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ecfef589-2ca3-4b21-bcd1-0cae319a5330 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:04.952713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ecfef589-2ca3-4b21-bcd1-0cae319a5330 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1462 microversion: 2.1 time: 0.084106 Jun 20 06:14:04.953269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 190/360] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:04 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:05.191146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-770f767a-9bd6-4044-a78a-e331b2ff7b13 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:05.191748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-770f767a-9bd6-4044-a78a-e331b2ff7b13 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:05.198769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-770f767a-9bd6-4044-a78a-e331b2ff7b13 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.199218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-770f767a-9bd6-4044-a78a-e331b2ff7b13 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:05.199970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-770f767a-9bd6-4044-a78a-e331b2ff7b13 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.200401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-770f767a-9bd6-4044-a78a-e331b2ff7b13 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:05.554066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-770f767a-9bd6-4044-a78a-e331b2ff7b13 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:05.563052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-770f767a-9bd6-4044-a78a-e331b2ff7b13 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.375629 Jun 20 06:14:05.563788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 171/361] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:05 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:05.969542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:05.970152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:05.976149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.976593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:05.978096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.978590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:06.007739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:06.008179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:06.009130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lazy-loading 'fault' on Instance uuid 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:14:06.052852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:06.060523 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-63e4055d-5c3e-4fac-9ce1-0d095df54a8e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1304 microversion: 2.1 time: 0.094784 Jun 20 06:14:06.061081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 191/362] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:05 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:06.580265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c4e9b42-c0be-4aea-8544-0c87efa1bc1d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:06.580802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c4e9b42-c0be-4aea-8544-0c87efa1bc1d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:06.587289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c4e9b42-c0be-4aea-8544-0c87efa1bc1d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:06.587744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c4e9b42-c0be-4aea-8544-0c87efa1bc1d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:06.588508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c4e9b42-c0be-4aea-8544-0c87efa1bc1d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:06.588951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c4e9b42-c0be-4aea-8544-0c87efa1bc1d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:06.726640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c4e9b42-c0be-4aea-8544-0c87efa1bc1d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:06.734484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c4e9b42-c0be-4aea-8544-0c87efa1bc1d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1510 microversion: 2.1 time: 0.157980 Jun 20 06:14:06.735037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 172/363] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:06 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:07.078127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:07.078858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:07.084697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.085249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.086191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.086623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.118939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.119811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.120034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lazy-loading 'fault' on Instance uuid 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:14:07.163269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:07.173159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-635f95fd-184e-46fc-9b49-953785b08acc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 200 len: 1304 microversion: 2.1 time: 0.098858 Jun 20 06:14:07.183012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 192/364] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:07 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:07.754738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-715c346d-1f2e-41cf-b73a-6106deeffd9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:07.755346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-715c346d-1f2e-41cf-b73a-6106deeffd9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:07.764478 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-715c346d-1f2e-41cf-b73a-6106deeffd9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.764927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-715c346d-1f2e-41cf-b73a-6106deeffd9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.765722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-715c346d-1f2e-41cf-b73a-6106deeffd9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.766184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-715c346d-1f2e-41cf-b73a-6106deeffd9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.892653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-715c346d-1f2e-41cf-b73a-6106deeffd9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:07.901893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-715c346d-1f2e-41cf-b73a-6106deeffd9d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1516 microversion: 2.1 time: 0.150880 Jun 20 06:14:07.902468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 173/365] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:07 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:08.191307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:08.192486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:08.199063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.199744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.200640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.201064 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.218195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] HTTP exception thrown: Instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 could not be found. Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Request method failure captured: Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 HTTP/1.1 Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_scbL3GTghPxd3-LHmI-1CSKfs2-EglRu3WYHeUXYFDe3mvgN2dtWHNER2wK2L_FcfUzIIKpoOTrqVZf-o3ilsnOiHhpB7oDair8rsaAX4IeFM4TpIpmpEjai_LB_YPzaCRqYv_B--19DB2YkDAxB_ypNPj3DsjtiG1VfIPTJsJqA Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: b23bb3e50977480db739a786dcf9827a Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesActionsTest-635831289 Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:14:08.219842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b23bb3e50977480db739a786dcf9827a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b23bb3e50977480db739a786dcf9827a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b23bb3e50977480db739a786dcf9827a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b23bb3e50977480db739a786dcf9827a"}]}] Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesActionsTest-635831289 Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b23bb3e50977480db739a786dcf9827a Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesActionsTest-635831289 Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesActionsTest-635831289-project Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: d1e03bec18c849e79bf2ce04ea496f62 Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesActionsTest-635831289-project Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 could not be found. Jun 20 06:14:08.221274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8'} Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 could not be found. Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:08.222329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 could not be found. Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 could not be found. Jun 20 06:14:08.223789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:08.236144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Returning 404 to user: Instance 41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:08.236144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-70798cab-e627-4308-a9c8-d1882d066d30 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8" status: 404 len: 111 microversion: 2.1 time: 0.034927 Jun 20 06:14:08.236144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 193/366] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:08 2022] GET /compute/v2.1/servers/41e2c3f8-9c9b-4aff-be29-5cb4fbcb6bf8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:08.348864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1196636038", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "networks": [{"uuid": "a2a155a6-b0ae-46dd-8198-5fe21e342de2"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:08.415242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] validate_networks() for [('a2a155a6-b0ae-46dd-8198-5fe21e342de2', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:14:08.788878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:14:08.789494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:14:08.790005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:14:08.790365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:14:08.790782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:14:08.800656 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.801031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.801877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.802302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.810349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.823846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Getting quotas for project b23bb3e50977480db739a786dcf9827a. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:08.828528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Getting quotas for user d1e03bec18c849e79bf2ce04ea496f62 and project b23bb3e50977480db739a786dcf9827a. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:08.840891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:14:08.843347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:14:08.891661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-328e4541-23e9-48ac-af42-4baaff4782e1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547486 Jun 20 06:14:08.892312 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 174/367] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:14:08.904489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc4fd5f0-76f9-4d18-ac07-e60a53de0e46 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:08.905287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc4fd5f0-76f9-4d18-ac07-e60a53de0e46 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:08.973229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc4fd5f0-76f9-4d18-ac07-e60a53de0e46 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:08.983092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc4fd5f0-76f9-4d18-ac07-e60a53de0e46 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1214 microversion: 2.1 time: 0.083935 Jun 20 06:14:08.983731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 194/368] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:08 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:09.244563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-99406156-080d-4f43-a6da-26231e390b0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'create', calling method: .version_select at 0x7f7a7a763e50>, body: {"keypair": {"name": "tempest-keypair-1341433137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe6vU0CjKNRAidoG0lHt+wVZ9DoTuB/98QsRC7cZnGdnQOOZ0MqxhLzq5edyOWICG+mNCI0+ub7WZ870baA/Fn+CIUCROCWkN883A6PdKF85XNN5QXp1jF7qc3xuxQPDw=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:09.260015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-99406156-080d-4f43-a6da-26231e390b0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Getting quotas for project 0614a239ccf84b5da75a269f3a0c6363. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:09.264318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-99406156-080d-4f43-a6da-26231e390b0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Getting quotas for user f49340b89c2a43b288572263ddac7be8 and project 0614a239ccf84b5da75a269f3a0c6363. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:09.295256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-99406156-080d-4f43-a6da-26231e390b0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054077 Jun 20 06:14:09.296228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 175/369] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:14:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:10.000899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c43897ab-922c-48c9-a4c4-d5471639e4b3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:10.001752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c43897ab-922c-48c9-a4c4-d5471639e4b3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:10.014693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c43897ab-922c-48c9-a4c4-d5471639e4b3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:10.015158 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c43897ab-922c-48c9-a4c4-d5471639e4b3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:10.015955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c43897ab-922c-48c9-a4c4-d5471639e4b3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:10.016397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c43897ab-922c-48c9-a4c4-d5471639e4b3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:10.172147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c43897ab-922c-48c9-a4c4-d5471639e4b3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:10.180424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c43897ab-922c-48c9-a4c4-d5471639e4b3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1266 microversion: 2.1 time: 0.184067 Jun 20 06:14:10.181645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 195/370] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:09 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:11.202566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-13f2a46e-6b67-4456-af75-2ad28350d472 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:11.203711 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-13f2a46e-6b67-4456-af75-2ad28350d472 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:11.215547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13f2a46e-6b67-4456-af75-2ad28350d472 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:11.217206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13f2a46e-6b67-4456-af75-2ad28350d472 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:11.218774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13f2a46e-6b67-4456-af75-2ad28350d472 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:11.219566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13f2a46e-6b67-4456-af75-2ad28350d472 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:11.327084 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-13f2a46e-6b67-4456-af75-2ad28350d472 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:11.341366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-13f2a46e-6b67-4456-af75-2ad28350d472 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1272 microversion: 2.1 time: 0.145179 Jun 20 06:14:11.342649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 176/371] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:11 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:11.769525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1267249509", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3076d5e2-52b9-49c2-9946-ddaefc227754"}], "security_groups": [{"name": "tempest-securitygroup--1842001333"}], "key_name": "tempest-keypair-1341433137", "user_data": "}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:11.957242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] validate_networks() for [('3076d5e2-52b9-49c2-9946-ddaefc227754', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:14:12.359620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-834bb03a-4020-483f-9b6d-eb60082b2ee3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:12.360974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-834bb03a-4020-483f-9b6d-eb60082b2ee3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:12.371664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-834bb03a-4020-483f-9b6d-eb60082b2ee3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.372312 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-834bb03a-4020-483f-9b6d-eb60082b2ee3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.373085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-834bb03a-4020-483f-9b6d-eb60082b2ee3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.373899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-834bb03a-4020-483f-9b6d-eb60082b2ee3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.696504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-834bb03a-4020-483f-9b6d-eb60082b2ee3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:12.712648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-834bb03a-4020-483f-9b6d-eb60082b2ee3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.356963 Jun 20 06:14:12.723176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 177/372] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:12 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:12.737620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:14:12.738050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:14:12.738542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:14:12.738950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:14:12.739378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:14:12.752550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.753083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.759459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-3c0fd8df-a44b-4794-8288-73f1c91169e2 req-ce17295f-31c8-41e3-9446-3d80263a8607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e76b3af-66f4-41a4-a5c3-d59530e8cb8b", "tag": "7ad276ed-b8b0-46a1-b430-daac22503e79"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:12.760668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.761892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.779602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-3c0fd8df-a44b-4794-8288-73f1c91169e2 req-ce17295f-31c8-41e3-9446-3d80263a8607 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.780058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-3c0fd8df-a44b-4794-8288-73f1c91169e2 req-ce17295f-31c8-41e3-9446-3d80263a8607 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.801456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Getting quotas for project 0614a239ccf84b5da75a269f3a0c6363. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:12.807373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-3c0fd8df-a44b-4794-8288-73f1c91169e2 req-ce17295f-31c8-41e3-9446-3d80263a8607 service nova] Creating event network-changed:7ad276ed-b8b0-46a1-b430-daac22503e79 for instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b on hv-cinder-80473 Jun 20 06:14:12.812600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-3c0fd8df-a44b-4794-8288-73f1c91169e2 req-ce17295f-31c8-41e3-9446-3d80263a8607 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057836 Jun 20 06:14:12.813483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 178/373] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:12.813830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Getting quotas for user f49340b89c2a43b288572263ddac7be8 and project 0614a239ccf84b5da75a269f3a0c6363. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:12.830820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:14:12.833125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:14:12.882980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5ce11e1f-76ec-40e9-9239-3bf87f4529c9 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.119418 Jun 20 06:14:12.889080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 196/374] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:14:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:14:12.897604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ca3468cc-f087-4b4a-b18a-02ba67118b09 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:12.898434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ca3468cc-f087-4b4a-b18a-02ba67118b09 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:12.995018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ca3468cc-f087-4b4a-b18a-02ba67118b09 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:13.004281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ca3468cc-f087-4b4a-b18a-02ba67118b09 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1246 microversion: 2.1 time: 0.113161 Jun 20 06:14:13.010335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 179/375] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:12 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1246 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:13.730912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-75656195-bffb-43e2-ae0f-93a3251d8851 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:13.731596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-75656195-bffb-43e2-ae0f-93a3251d8851 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:13.738547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75656195-bffb-43e2-ae0f-93a3251d8851 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:13.739100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75656195-bffb-43e2-ae0f-93a3251d8851 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:13.739940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75656195-bffb-43e2-ae0f-93a3251d8851 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:13.740384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75656195-bffb-43e2-ae0f-93a3251d8851 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:13.886349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-75656195-bffb-43e2-ae0f-93a3251d8851 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:13.893892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-75656195-bffb-43e2-ae0f-93a3251d8851 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.168146 Jun 20 06:14:13.894438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 197/376] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:13 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:14.022337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-49678e35-6330-4162-8cea-44987c0031fe tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:14.022869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-49678e35-6330-4162-8cea-44987c0031fe tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:14.030481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49678e35-6330-4162-8cea-44987c0031fe tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:14.030938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49678e35-6330-4162-8cea-44987c0031fe tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:14.031708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49678e35-6330-4162-8cea-44987c0031fe tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:14.032148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49678e35-6330-4162-8cea-44987c0031fe tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:14.094781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49678e35-6330-4162-8cea-44987c0031fe tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:14.102823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-49678e35-6330-4162-8cea-44987c0031fe tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1250 microversion: 2.1 time: 0.084033 Jun 20 06:14:14.103391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 180/377] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:14 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:14.914915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-97b18208-74bf-4fdf-a859-3454eeab5288 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:14.914915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-97b18208-74bf-4fdf-a859-3454eeab5288 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:14.920865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97b18208-74bf-4fdf-a859-3454eeab5288 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:14.921305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97b18208-74bf-4fdf-a859-3454eeab5288 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:14.922089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97b18208-74bf-4fdf-a859-3454eeab5288 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:14.922518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97b18208-74bf-4fdf-a859-3454eeab5288 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:15.083484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-97b18208-74bf-4fdf-a859-3454eeab5288 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:15.094818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-97b18208-74bf-4fdf-a859-3454eeab5288 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.187101 Jun 20 06:14:15.099612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 198/378] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:14 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:15.120110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2cde9aa9-971f-413b-bc02-c33ca00886ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:15.120729 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2cde9aa9-971f-413b-bc02-c33ca00886ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:15.128828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2cde9aa9-971f-413b-bc02-c33ca00886ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:15.129280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2cde9aa9-971f-413b-bc02-c33ca00886ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:15.130091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2cde9aa9-971f-413b-bc02-c33ca00886ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:15.130524 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2cde9aa9-971f-413b-bc02-c33ca00886ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:15.207389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2cde9aa9-971f-413b-bc02-c33ca00886ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:15.215574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2cde9aa9-971f-413b-bc02-c33ca00886ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1250 microversion: 2.1 time: 0.099784 Jun 20 06:14:15.216421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 181/379] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:15 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1250 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:16.117289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-160ba765-0385-4ff3-bab4-1bd7a242f8ba tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:16.119402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-160ba765-0385-4ff3-bab4-1bd7a242f8ba tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:16.128879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-160ba765-0385-4ff3-bab4-1bd7a242f8ba tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:16.129864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-160ba765-0385-4ff3-bab4-1bd7a242f8ba tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:16.131528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-160ba765-0385-4ff3-bab4-1bd7a242f8ba tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:16.132293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-160ba765-0385-4ff3-bab4-1bd7a242f8ba tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:16.234502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b58630f1-b56e-4a0a-9c56-c17fe87cef8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:16.235354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b58630f1-b56e-4a0a-9c56-c17fe87cef8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:16.248857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b58630f1-b56e-4a0a-9c56-c17fe87cef8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:16.250920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b58630f1-b56e-4a0a-9c56-c17fe87cef8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:16.251724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b58630f1-b56e-4a0a-9c56-c17fe87cef8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:16.252355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b58630f1-b56e-4a0a-9c56-c17fe87cef8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:16.284823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-160ba765-0385-4ff3-bab4-1bd7a242f8ba tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:16.297462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-160ba765-0385-4ff3-bab4-1bd7a242f8ba tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.184955 Jun 20 06:14:16.298314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 199/380] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:16 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:16.372846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b58630f1-b56e-4a0a-9c56-c17fe87cef8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:16.386938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b58630f1-b56e-4a0a-9c56-c17fe87cef8a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1242 microversion: 2.1 time: 0.156375 Jun 20 06:14:16.388235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 182/381] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:16 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:17.314707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dddc85d0-f092-4d56-85f7-6611b64a62bc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:17.315890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dddc85d0-f092-4d56-85f7-6611b64a62bc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:17.324357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dddc85d0-f092-4d56-85f7-6611b64a62bc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:17.325260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dddc85d0-f092-4d56-85f7-6611b64a62bc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:17.326802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dddc85d0-f092-4d56-85f7-6611b64a62bc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:17.327378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dddc85d0-f092-4d56-85f7-6611b64a62bc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:17.406248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6f76190f-1869-4ad3-8aca-cff61211fb0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:17.407549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6f76190f-1869-4ad3-8aca-cff61211fb0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:17.415061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f76190f-1869-4ad3-8aca-cff61211fb0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:17.415512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f76190f-1869-4ad3-8aca-cff61211fb0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:17.416500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f76190f-1869-4ad3-8aca-cff61211fb0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:17.417836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f76190f-1869-4ad3-8aca-cff61211fb0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:17.548828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6f76190f-1869-4ad3-8aca-cff61211fb0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:17.561181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6f76190f-1869-4ad3-8aca-cff61211fb0a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1306 microversion: 2.1 time: 0.159597 Jun 20 06:14:17.562306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 183/382] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:17 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:17.602334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dddc85d0-f092-4d56-85f7-6611b64a62bc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:17.615969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dddc85d0-f092-4d56-85f7-6611b64a62bc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.304954 Jun 20 06:14:17.617031 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 200/383] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:17 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:17.768683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-da7ac82e-ed87-45c3-8a9e-3a71adcd6f47 req-19bc053a-d34b-44c6-b14a-c42008ca5dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e76b3af-66f4-41a4-a5c3-d59530e8cb8b", "name": "network-vif-plugged", "status": "completed", "tag": "7ad276ed-b8b0-46a1-b430-daac22503e79"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:17.777695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-da7ac82e-ed87-45c3-8a9e-3a71adcd6f47 req-19bc053a-d34b-44c6-b14a-c42008ca5dbf service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:17.778195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-da7ac82e-ed87-45c3-8a9e-3a71adcd6f47 req-19bc053a-d34b-44c6-b14a-c42008ca5dbf service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:17.799717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-da7ac82e-ed87-45c3-8a9e-3a71adcd6f47 req-19bc053a-d34b-44c6-b14a-c42008ca5dbf service nova] Creating event network-vif-plugged:7ad276ed-b8b0-46a1-b430-daac22503e79 for instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b on hv-cinder-80473 Jun 20 06:14:17.807249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-da7ac82e-ed87-45c3-8a9e-3a71adcd6f47 req-19bc053a-d34b-44c6-b14a-c42008ca5dbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042412 Jun 20 06:14:17.808024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 184/384] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:18.579364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ee4807f4-90e6-407c-ad5f-887e0d1f2725 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:18.579973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ee4807f4-90e6-407c-ad5f-887e0d1f2725 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:18.582836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:18.593874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee4807f4-90e6-407c-ad5f-887e0d1f2725 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:18.594322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee4807f4-90e6-407c-ad5f-887e0d1f2725 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:18.595101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee4807f4-90e6-407c-ad5f-887e0d1f2725 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:18.596122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee4807f4-90e6-407c-ad5f-887e0d1f2725 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:18.635477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ae849b4-6e2d-4a84-ac6c-44bebe800fc9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:18.636998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8ae849b4-6e2d-4a84-ac6c-44bebe800fc9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:18.643706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ae849b4-6e2d-4a84-ac6c-44bebe800fc9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:18.644165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ae849b4-6e2d-4a84-ac6c-44bebe800fc9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:18.645281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ae849b4-6e2d-4a84-ac6c-44bebe800fc9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:18.645748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ae849b4-6e2d-4a84-ac6c-44bebe800fc9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:18.811363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:18.837548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ee4807f4-90e6-407c-ad5f-887e0d1f2725 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:18.846550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ee4807f4-90e6-407c-ad5f-887e0d1f2725 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.271368 Jun 20 06:14:18.857246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8ae849b4-6e2d-4a84-ac6c-44bebe800fc9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:18.858476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 201/385] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:18 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:18.865319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ae849b4-6e2d-4a84-ac6c-44bebe800fc9 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.234488 Jun 20 06:14:18.865907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 185/386] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:18 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:19.864065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-07fb7aaf-7ac6-4c6e-862e-ddcb0bbe2bba tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:19.864784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-07fb7aaf-7ac6-4c6e-862e-ddcb0bbe2bba tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:19.871546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-07fb7aaf-7ac6-4c6e-862e-ddcb0bbe2bba tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.872238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-07fb7aaf-7ac6-4c6e-862e-ddcb0bbe2bba tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.873006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-07fb7aaf-7ac6-4c6e-862e-ddcb0bbe2bba tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.873477 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-07fb7aaf-7ac6-4c6e-862e-ddcb0bbe2bba tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.884819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0c291f3a-b158-4730-8607-9560476a92ed tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:19.885685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0c291f3a-b158-4730-8607-9560476a92ed tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:19.893803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c291f3a-b158-4730-8607-9560476a92ed tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.894244 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c291f3a-b158-4730-8607-9560476a92ed tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.895309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c291f3a-b158-4730-8607-9560476a92ed tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.895784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0c291f3a-b158-4730-8607-9560476a92ed tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:20.098422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-07fb7aaf-7ac6-4c6e-862e-ddcb0bbe2bba tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:20.101820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0c291f3a-b158-4730-8607-9560476a92ed tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:20.109541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-07fb7aaf-7ac6-4c6e-862e-ddcb0bbe2bba tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.249204 Jun 20 06:14:20.110129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 202/387] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:19 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:20.112284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0c291f3a-b158-4730-8607-9560476a92ed tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.232481 Jun 20 06:14:20.113699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 186/388] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:19 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:21.125603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2d1123d2-e479-4558-a6a1-1c0e71400887 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:21.126295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2d1123d2-e479-4558-a6a1-1c0e71400887 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:21.127820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-28ae4e0f-108c-4c52-8ff9-fe5b06b6ebd1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:21.129074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-28ae4e0f-108c-4c52-8ff9-fe5b06b6ebd1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:21.131679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:21.132395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d1123d2-e479-4558-a6a1-1c0e71400887 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.132839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d1123d2-e479-4558-a6a1-1c0e71400887 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.133916 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d1123d2-e479-4558-a6a1-1c0e71400887 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.134350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d1123d2-e479-4558-a6a1-1c0e71400887 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.142942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28ae4e0f-108c-4c52-8ff9-fe5b06b6ebd1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.143738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28ae4e0f-108c-4c52-8ff9-fe5b06b6ebd1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.144626 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28ae4e0f-108c-4c52-8ff9-fe5b06b6ebd1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.145600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-28ae4e0f-108c-4c52-8ff9-fe5b06b6ebd1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.336216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-28ae4e0f-108c-4c52-8ff9-fe5b06b6ebd1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:21.339329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2d1123d2-e479-4558-a6a1-1c0e71400887 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:21.344182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-28ae4e0f-108c-4c52-8ff9-fe5b06b6ebd1 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.220110 Jun 20 06:14:21.345060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 187/389] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:21 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:21.347835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2d1123d2-e479-4558-a6a1-1c0e71400887 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.226000 Jun 20 06:14:21.348470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 203/390] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:21 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:22.361615 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b6292f86-3fba-4d47-b279-ed6752c2c263 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:22.362231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b6292f86-3fba-4d47-b279-ed6752c2c263 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:22.366116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bfa1a3b7-2676-4e0a-a8f0-9d404e87870d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:22.366806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bfa1a3b7-2676-4e0a-a8f0-9d404e87870d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:22.371318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6292f86-3fba-4d47-b279-ed6752c2c263 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.371843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6292f86-3fba-4d47-b279-ed6752c2c263 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.372949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6292f86-3fba-4d47-b279-ed6752c2c263 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.373410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6292f86-3fba-4d47-b279-ed6752c2c263 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.376458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfa1a3b7-2676-4e0a-a8f0-9d404e87870d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.377087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfa1a3b7-2676-4e0a-a8f0-9d404e87870d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.378102 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfa1a3b7-2676-4e0a-a8f0-9d404e87870d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.378637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfa1a3b7-2676-4e0a-a8f0-9d404e87870d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.615150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bfa1a3b7-2676-4e0a-a8f0-9d404e87870d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:22.619529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b6292f86-3fba-4d47-b279-ed6752c2c263 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:22.632004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b6292f86-3fba-4d47-b279-ed6752c2c263 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.273264 Jun 20 06:14:22.636387 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 188/391] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:22 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:22.648119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bfa1a3b7-2676-4e0a-a8f0-9d404e87870d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.286557 Jun 20 06:14:22.650056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 204/392] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:22 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:23.343517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8697cdf4-1fd1-467d-bb80-dca03b097158 req-bad1cc6c-9973-4f15-a604-7294f058dfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03d50ed-386e-42ee-af59-9a0231218aa2", "tag": "dd50376a-5980-4629-b056-2a634e6fb53b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:23.347084 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=12 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:23.358485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8697cdf4-1fd1-467d-bb80-dca03b097158 req-bad1cc6c-9973-4f15-a604-7294f058dfb1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.359715 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8697cdf4-1fd1-467d-bb80-dca03b097158 req-bad1cc6c-9973-4f15-a604-7294f058dfb1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.380076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8697cdf4-1fd1-467d-bb80-dca03b097158 req-bad1cc6c-9973-4f15-a604-7294f058dfb1 service nova] Creating event network-changed:dd50376a-5980-4629-b056-2a634e6fb53b for instance c03d50ed-386e-42ee-af59-9a0231218aa2 on hv-cinder-80473 Jun 20 06:14:23.388298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8697cdf4-1fd1-467d-bb80-dca03b097158 req-bad1cc6c-9973-4f15-a604-7294f058dfb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048317 Jun 20 06:14:23.390359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 189/393] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:23.649459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:23.650517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=8 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:23.654991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-25237fbf-1c97-4aeb-9060-d65fe4b2d27e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:23.655617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-25237fbf-1c97-4aeb-9060-d65fe4b2d27e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:23.666177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-25237fbf-1c97-4aeb-9060-d65fe4b2d27e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.666747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b233aaf0-9b33-41b2-b6b0-92706e9e2cce tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:23.666872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-25237fbf-1c97-4aeb-9060-d65fe4b2d27e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.667442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b233aaf0-9b33-41b2-b6b0-92706e9e2cce tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:23.667855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-25237fbf-1c97-4aeb-9060-d65fe4b2d27e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.668395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-25237fbf-1c97-4aeb-9060-d65fe4b2d27e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.673633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b233aaf0-9b33-41b2-b6b0-92706e9e2cce tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.674289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b233aaf0-9b33-41b2-b6b0-92706e9e2cce tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.675222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b233aaf0-9b33-41b2-b6b0-92706e9e2cce tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.675655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b233aaf0-9b33-41b2-b6b0-92706e9e2cce tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.879790 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-25237fbf-1c97-4aeb-9060-d65fe4b2d27e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:23.884185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b233aaf0-9b33-41b2-b6b0-92706e9e2cce tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:23.888136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-25237fbf-1c97-4aeb-9060-d65fe4b2d27e tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1314 microversion: 2.1 time: 0.239986 Jun 20 06:14:23.888764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 205/394] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:23 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:23.892600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b233aaf0-9b33-41b2-b6b0-92706e9e2cce tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.230555 Jun 20 06:14:23.893164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 190/395] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:23 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:24.905667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b039c13e-447b-4daf-bf08-8b59031d4360 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:24.906249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b039c13e-447b-4daf-bf08-8b59031d4360 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:24.910728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-858c6c33-ee28-4d47-9b26-4cae7d54b5a6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:24.911344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-858c6c33-ee28-4d47-9b26-4cae7d54b5a6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:24.912278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b039c13e-447b-4daf-bf08-8b59031d4360 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.912726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b039c13e-447b-4daf-bf08-8b59031d4360 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:24.913587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b039c13e-447b-4daf-bf08-8b59031d4360 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.914075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b039c13e-447b-4daf-bf08-8b59031d4360 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:24.918306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-858c6c33-ee28-4d47-9b26-4cae7d54b5a6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.918770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-858c6c33-ee28-4d47-9b26-4cae7d54b5a6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:24.919547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-858c6c33-ee28-4d47-9b26-4cae7d54b5a6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.919989 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-858c6c33-ee28-4d47-9b26-4cae7d54b5a6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:25.116593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b039c13e-447b-4daf-bf08-8b59031d4360 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:25.125172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-858c6c33-ee28-4d47-9b26-4cae7d54b5a6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:25.131366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b039c13e-447b-4daf-bf08-8b59031d4360 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1498 microversion: 2.1 time: 0.229501 Jun 20 06:14:25.132136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 206/396] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:24 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:25.143855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-858c6c33-ee28-4d47-9b26-4cae7d54b5a6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.225865 Jun 20 06:14:25.144822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 191/397] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:24 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:25.780767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c760f415-f06e-4409-bb4c-c0969b88a231 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:25.781257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c760f415-f06e-4409-bb4c-c0969b88a231 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:25.787166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c760f415-f06e-4409-bb4c-c0969b88a231 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:25.787804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c760f415-f06e-4409-bb4c-c0969b88a231 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:25.788560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c760f415-f06e-4409-bb4c-c0969b88a231 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:25.788989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c760f415-f06e-4409-bb4c-c0969b88a231 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:25.808899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:25.815917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c760f415-f06e-4409-bb4c-c0969b88a231 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:14:25.894511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c760f415-f06e-4409-bb4c-c0969b88a231 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 204 len: 0 microversion: 2.1 time: 0.117310 Jun 20 06:14:25.895560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 207/398] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:14:25 2022] DELETE /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:14:25.904635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-faa22229-115f-4f59-8e8d-f3489a826aa2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:25.905269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-faa22229-115f-4f59-8e8d-f3489a826aa2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:25.911274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-faa22229-115f-4f59-8e8d-f3489a826aa2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:25.911862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-faa22229-115f-4f59-8e8d-f3489a826aa2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:25.912563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-faa22229-115f-4f59-8e8d-f3489a826aa2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:25.912997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-faa22229-115f-4f59-8e8d-f3489a826aa2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:26.058848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-faa22229-115f-4f59-8e8d-f3489a826aa2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:26.066309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-faa22229-115f-4f59-8e8d-f3489a826aa2 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1504 microversion: 2.1 time: 0.165553 Jun 20 06:14:26.066858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 192/399] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:25 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:26.162175 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-373c74da-3eb1-4ed6-9f5d-abd0b516b54d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:26.162888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-373c74da-3eb1-4ed6-9f5d-abd0b516b54d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:26.169798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-373c74da-3eb1-4ed6-9f5d-abd0b516b54d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:26.170255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-373c74da-3eb1-4ed6-9f5d-abd0b516b54d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:26.171030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-373c74da-3eb1-4ed6-9f5d-abd0b516b54d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:26.171467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-373c74da-3eb1-4ed6-9f5d-abd0b516b54d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:26.312696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-373c74da-3eb1-4ed6-9f5d-abd0b516b54d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:26.321442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-373c74da-3eb1-4ed6-9f5d-abd0b516b54d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.163634 Jun 20 06:14:26.322166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 208/400] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:26 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:27.083770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-79017e7c-eec9-4f1b-9ea8-aae22de3dace tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:27.084372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-79017e7c-eec9-4f1b-9ea8-aae22de3dace tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:27.091411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79017e7c-eec9-4f1b-9ea8-aae22de3dace tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:27.092475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79017e7c-eec9-4f1b-9ea8-aae22de3dace tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:27.093269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79017e7c-eec9-4f1b-9ea8-aae22de3dace tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:27.093710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79017e7c-eec9-4f1b-9ea8-aae22de3dace tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:27.301327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79017e7c-eec9-4f1b-9ea8-aae22de3dace tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:27.308830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-79017e7c-eec9-4f1b-9ea8-aae22de3dace tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1504 microversion: 2.1 time: 0.228905 Jun 20 06:14:27.310095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 193/401] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:27 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:27.340241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-972db3db-674c-4b55-9f1c-92f8dfa7d2e5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:27.340894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-972db3db-674c-4b55-9f1c-92f8dfa7d2e5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:27.347006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-972db3db-674c-4b55-9f1c-92f8dfa7d2e5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:27.347456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-972db3db-674c-4b55-9f1c-92f8dfa7d2e5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:27.348226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-972db3db-674c-4b55-9f1c-92f8dfa7d2e5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:27.348663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-972db3db-674c-4b55-9f1c-92f8dfa7d2e5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:27.547245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-972db3db-674c-4b55-9f1c-92f8dfa7d2e5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:27.555367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-972db3db-674c-4b55-9f1c-92f8dfa7d2e5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.220033 Jun 20 06:14:27.556555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 209/402] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:27 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:28.326589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1754d3cf-c18f-40d5-84ea-98e79507bdc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:28.327756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1754d3cf-c18f-40d5-84ea-98e79507bdc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:28.340515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1754d3cf-c18f-40d5-84ea-98e79507bdc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.341208 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1754d3cf-c18f-40d5-84ea-98e79507bdc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.342471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1754d3cf-c18f-40d5-84ea-98e79507bdc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.343063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1754d3cf-c18f-40d5-84ea-98e79507bdc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.551706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1754d3cf-c18f-40d5-84ea-98e79507bdc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:28.559437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1754d3cf-c18f-40d5-84ea-98e79507bdc3 tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1504 microversion: 2.1 time: 0.236804 Jun 20 06:14:28.560016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 194/403] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:28 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:28.579771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-746fe66a-e801-4609-a908-d8040a3d7543 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:28.580303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-746fe66a-e801-4609-a908-d8040a3d7543 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:28.587404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-746fe66a-e801-4609-a908-d8040a3d7543 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.587853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-746fe66a-e801-4609-a908-d8040a3d7543 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.588620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-746fe66a-e801-4609-a908-d8040a3d7543 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.589226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-746fe66a-e801-4609-a908-d8040a3d7543 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.773072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-746fe66a-e801-4609-a908-d8040a3d7543 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:28.781282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-746fe66a-e801-4609-a908-d8040a3d7543 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.205360 Jun 20 06:14:28.781885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 210/404] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:28 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:29.578292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-97725bb3-70f8-4f52-8d04-dc3117b553be tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:29.579856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-97725bb3-70f8-4f52-8d04-dc3117b553be tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:29.591479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97725bb3-70f8-4f52-8d04-dc3117b553be tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.592422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97725bb3-70f8-4f52-8d04-dc3117b553be tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.593319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97725bb3-70f8-4f52-8d04-dc3117b553be tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.594632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97725bb3-70f8-4f52-8d04-dc3117b553be tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.634052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:29.690240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-97725bb3-70f8-4f52-8d04-dc3117b553be tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:29.697998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-97725bb3-70f8-4f52-8d04-dc3117b553be tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1462 microversion: 2.1 time: 0.124473 Jun 20 06:14:29.698695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 195/405] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:29 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1462 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:29.782102 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-017161bd-1550-4aab-b0bf-dcc3f13d1763 req-e7227539-90e5-47db-930f-3db47b875ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e76b3af-66f4-41a4-a5c3-d59530e8cb8b", "name": "network-vif-deleted", "tag": "7ad276ed-b8b0-46a1-b430-daac22503e79"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:29.800328 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cebf417d-0562-4ed8-b8ff-53736f6f5c3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:29.800961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cebf417d-0562-4ed8-b8ff-53736f6f5c3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:29.812078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cebf417d-0562-4ed8-b8ff-53736f6f5c3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.813006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-017161bd-1550-4aab-b0bf-dcc3f13d1763 req-e7227539-90e5-47db-930f-3db47b875ec9 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.815866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cebf417d-0562-4ed8-b8ff-53736f6f5c3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.816839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cebf417d-0562-4ed8-b8ff-53736f6f5c3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.817258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-017161bd-1550-4aab-b0bf-dcc3f13d1763 req-e7227539-90e5-47db-930f-3db47b875ec9 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.817406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cebf417d-0562-4ed8-b8ff-53736f6f5c3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.838506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-017161bd-1550-4aab-b0bf-dcc3f13d1763 req-e7227539-90e5-47db-930f-3db47b875ec9 service nova] Creating event network-vif-deleted:7ad276ed-b8b0-46a1-b430-daac22503e79 for instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b on hv-cinder-80473 Jun 20 06:14:29.846505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-017161bd-1550-4aab-b0bf-dcc3f13d1763 req-e7227539-90e5-47db-930f-3db47b875ec9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068943 Jun 20 06:14:29.848120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 211/406] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:30.012858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cebf417d-0562-4ed8-b8ff-53736f6f5c3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:30.021987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cebf417d-0562-4ed8-b8ff-53736f6f5c3c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.226202 Jun 20 06:14:30.022751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 196/407] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:29 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:30.716267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:30.717261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:30.724428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.725246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.726255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.727214 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.766192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.767058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.768234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lazy-loading 'fault' on Instance uuid 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:14:30.823151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e03bec18c849e79bf2ce04ea496f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bb3e50977480db739a786dcf9827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:30.831062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f0e9fd9b-dcfa-4713-8ca1-86ec6fc8aacc tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 200 len: 1304 microversion: 2.1 time: 0.119113 Jun 20 06:14:30.831854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 212/408] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:30 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:31.039952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9c60cef5-9018-4560-83b3-ba36dd77940e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:31.040555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9c60cef5-9018-4560-83b3-ba36dd77940e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:31.047458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c60cef5-9018-4560-83b3-ba36dd77940e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.047907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c60cef5-9018-4560-83b3-ba36dd77940e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.048673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c60cef5-9018-4560-83b3-ba36dd77940e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.049294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c60cef5-9018-4560-83b3-ba36dd77940e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.243938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9c60cef5-9018-4560-83b3-ba36dd77940e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:31.252486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9c60cef5-9018-4560-83b3-ba36dd77940e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.216364 Jun 20 06:14:31.253445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 197/409] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:31 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:31.848698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:31.849351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] [instance: 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:31.858489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.863377 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.864546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.864966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.903293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] HTTP exception thrown: Instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b could not be found. Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Request method failure captured: Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b HTTP/1.1 Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_scbL3GTghPxd3-LHmI-1CSKfs2-EglRu3WYHeUXYFDe3mvgN2dtWHNER2wK2L_FcfUzIIKpoOTrqVZf-o3ilsnOiHhpB7oDair8rsaAX4IeFM4TpIpmpEjai_LB_YPzaCRqYv_B--19DB2YkDAxB_ypNPj3DsjtiG1VfIPTJsJqA Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: b23bb3e50977480db739a786dcf9827a Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesActionsTest-635831289 Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:14:31.906479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b23bb3e50977480db739a786dcf9827a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b23bb3e50977480db739a786dcf9827a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b23bb3e50977480db739a786dcf9827a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b23bb3e50977480db739a786dcf9827a"}]}] Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesActionsTest-635831289 Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b23bb3e50977480db739a786dcf9827a Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesActionsTest-635831289 Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesActionsTest-635831289-project Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: d1e03bec18c849e79bf2ce04ea496f62 Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesActionsTest-635831289-project Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b could not be found. Jun 20 06:14:31.908410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '4e76b3af-66f4-41a4-a5c3-d59530e8cb8b'} Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b could not be found. Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:31.909296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b could not be found. Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b could not be found. Jun 20 06:14:31.910777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:14:31.912053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] Returning 404 to user: Instance 4e76b3af-66f4-41a4-a5c3-d59530e8cb8b could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:31.912551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-45ae905d-2af4-4432-b1ef-34b281f6df6b tempest-VolumesActionsTest-635831289 tempest-VolumesActionsTest-635831289-project] 10.222.0.16 "GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b" status: 404 len: 111 microversion: 2.1 time: 0.067598 Jun 20 06:14:31.913728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 213/410] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:31 2022] GET /compute/v2.1/servers/4e76b3af-66f4-41a4-a5c3-d59530e8cb8b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:32.208284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-63dc4d59-5b4a-4c68-86d4-e238089f37a0 req-d7284a15-0d75-436d-88ad-5f31ac1ee3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03d50ed-386e-42ee-af59-9a0231218aa2", "name": "network-vif-plugged", "status": "completed", "tag": "dd50376a-5980-4629-b056-2a634e6fb53b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:32.219188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-63dc4d59-5b4a-4c68-86d4-e238089f37a0 req-d7284a15-0d75-436d-88ad-5f31ac1ee3ac service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:32.219849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-63dc4d59-5b4a-4c68-86d4-e238089f37a0 req-d7284a15-0d75-436d-88ad-5f31ac1ee3ac service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:32.240653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-63dc4d59-5b4a-4c68-86d4-e238089f37a0 req-d7284a15-0d75-436d-88ad-5f31ac1ee3ac service nova] Creating event network-vif-plugged:dd50376a-5980-4629-b056-2a634e6fb53b for instance c03d50ed-386e-42ee-af59-9a0231218aa2 on hv-cinder-80473 Jun 20 06:14:32.270364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-63dc4d59-5b4a-4c68-86d4-e238089f37a0 req-d7284a15-0d75-436d-88ad-5f31ac1ee3ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065481 Jun 20 06:14:32.271360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cb2f9823-fb3b-4e16-aa6f-a2e06cd034c5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:32.272368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cb2f9823-fb3b-4e16-aa6f-a2e06cd034c5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:32.272832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 198/411] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:32.280740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cb2f9823-fb3b-4e16-aa6f-a2e06cd034c5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:32.281714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cb2f9823-fb3b-4e16-aa6f-a2e06cd034c5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:32.283601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cb2f9823-fb3b-4e16-aa6f-a2e06cd034c5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:32.284246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cb2f9823-fb3b-4e16-aa6f-a2e06cd034c5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:32.604388 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cb2f9823-fb3b-4e16-aa6f-a2e06cd034c5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:32.612888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cb2f9823-fb3b-4e16-aa6f-a2e06cd034c5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.346280 Jun 20 06:14:32.613552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 214/412] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:32 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:33.632034 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-46220be5-68ed-4320-90f9-5e92aa802ef0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:33.633372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-46220be5-68ed-4320-90f9-5e92aa802ef0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:33.640894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-46220be5-68ed-4320-90f9-5e92aa802ef0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.641351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-46220be5-68ed-4320-90f9-5e92aa802ef0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.642149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-46220be5-68ed-4320-90f9-5e92aa802ef0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.642765 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-46220be5-68ed-4320-90f9-5e92aa802ef0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.796446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-46220be5-68ed-4320-90f9-5e92aa802ef0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:33.811691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-46220be5-68ed-4320-90f9-5e92aa802ef0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.184416 Jun 20 06:14:33.813872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 199/413] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:33 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:34.830303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2e9adbe3-930b-4f9a-9648-922f4b09590e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:34.831576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2e9adbe3-930b-4f9a-9648-922f4b09590e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:34.838294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e9adbe3-930b-4f9a-9648-922f4b09590e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:34.838749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e9adbe3-930b-4f9a-9648-922f4b09590e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:34.839747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e9adbe3-930b-4f9a-9648-922f4b09590e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:34.840377 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e9adbe3-930b-4f9a-9648-922f4b09590e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.006438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2e9adbe3-930b-4f9a-9648-922f4b09590e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:35.014175 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2e9adbe3-930b-4f9a-9648-922f4b09590e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.187790 Jun 20 06:14:35.014955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 215/414] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:34 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:36.032218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ba537242-1708-445a-9fa9-99081a25de54 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:36.033709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ba537242-1708-445a-9fa9-99081a25de54 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:36.040712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba537242-1708-445a-9fa9-99081a25de54 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.041495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba537242-1708-445a-9fa9-99081a25de54 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.042438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba537242-1708-445a-9fa9-99081a25de54 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.043039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba537242-1708-445a-9fa9-99081a25de54 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.314882 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ba537242-1708-445a-9fa9-99081a25de54 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:36.328950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ba537242-1708-445a-9fa9-99081a25de54 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.300597 Jun 20 06:14:36.338536 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 200/415] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:36 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:37.346764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4075f420-9d9f-4283-87a3-48a8742d2106 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:37.347793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4075f420-9d9f-4283-87a3-48a8742d2106 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:37.356135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4075f420-9d9f-4283-87a3-48a8742d2106 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:37.357018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4075f420-9d9f-4283-87a3-48a8742d2106 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.358467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4075f420-9d9f-4283-87a3-48a8742d2106 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:37.359339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4075f420-9d9f-4283-87a3-48a8742d2106 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.582071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4075f420-9d9f-4283-87a3-48a8742d2106 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:37.593781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4075f420-9d9f-4283-87a3-48a8742d2106 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1372 microversion: 2.1 time: 0.251149 Jun 20 06:14:37.594687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 216/416] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:37 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:38.188585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f97f8529-21c2-494d-98a6-929831e7f072 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Action: 'create', calling method: .version_select at 0x7f7a7afe8b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-447985312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMGJnQSJ0Q5I0NK/UguDb7mc7vaMHkOH1lDi51IO/baXhxVCz0N44Xaqngl4A/zEtwWmtbWP4BwHJMJ6i7V2cITgAf3mbIjb2vSeaGcCL77KE4RqWyECSpDQqp3PURXlA=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:38.207035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-f97f8529-21c2-494d-98a6-929831e7f072 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Getting quotas for project a80966bf28184a9f8e9987632f7c0973. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:38.212273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-f97f8529-21c2-494d-98a6-929831e7f072 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Getting quotas for user 6f577abe1ada45979d5cb550073ae6a8 and project a80966bf28184a9f8e9987632f7c0973. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:38.236348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f97f8529-21c2-494d-98a6-929831e7f072 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.294751 Jun 20 06:14:38.236967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 201/417] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:14:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:38.611204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-59aecea9-8a47-4b0d-bf45-e63d2bc35712 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:38.612533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-59aecea9-8a47-4b0d-bf45-e63d2bc35712 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:38.619351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-59aecea9-8a47-4b0d-bf45-e63d2bc35712 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.620089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-59aecea9-8a47-4b0d-bf45-e63d2bc35712 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.621076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-59aecea9-8a47-4b0d-bf45-e63d2bc35712 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.621844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-59aecea9-8a47-4b0d-bf45-e63d2bc35712 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.785600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-59aecea9-8a47-4b0d-bf45-e63d2bc35712 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:38.794379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-59aecea9-8a47-4b0d-bf45-e63d2bc35712 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1566 microversion: 2.1 time: 0.185955 Jun 20 06:14:38.794379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 217/418] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:38 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:38.813814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ffe86793-e7e2-48e6-9d54-52512f74c40a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:38.815231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ffe86793-e7e2-48e6-9d54-52512f74c40a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:38.826318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffe86793-e7e2-48e6-9d54-52512f74c40a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.826767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffe86793-e7e2-48e6-9d54-52512f74c40a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.828041 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffe86793-e7e2-48e6-9d54-52512f74c40a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.839958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffe86793-e7e2-48e6-9d54-52512f74c40a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:39.036010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ffe86793-e7e2-48e6-9d54-52512f74c40a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.229142 Jun 20 06:14:39.037352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 202/419] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jun 20 06:14:38 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:40.051415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:14:40.052946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:14:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:14:40.763637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-3a5bdd22-61a3-41c5-a737-d98f6ecfe907 req-27657d92-995e-489c-9b1f-327673595100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03d50ed-386e-42ee-af59-9a0231218aa2", "tag": "dd50376a-5980-4629-b056-2a634e6fb53b"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:40.778620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-3a5bdd22-61a3-41c5-a737-d98f6ecfe907 req-27657d92-995e-489c-9b1f-327673595100 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:40.779402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-3a5bdd22-61a3-41c5-a737-d98f6ecfe907 req-27657d92-995e-489c-9b1f-327673595100 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:40.791514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-3a5bdd22-61a3-41c5-a737-d98f6ecfe907 req-27657d92-995e-489c-9b1f-327673595100 service nova] Creating event network-changed:dd50376a-5980-4629-b056-2a634e6fb53b for instance c03d50ed-386e-42ee-af59-9a0231218aa2 on hv-cinder-80473 Jun 20 06:14:40.817323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-3a5bdd22-61a3-41c5-a737-d98f6ecfe907 req-27657d92-995e-489c-9b1f-327673595100 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057523 Jun 20 06:14:40.824917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 218/420] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:59.575406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:59.576160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:59.576872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=32 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:59.581975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-51693135-e3ac-48ac-85c9-43eeb904b193 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:59.582547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-51693135-e3ac-48ac-85c9-43eeb904b193 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:59.591662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51693135-e3ac-48ac-85c9-43eeb904b193 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:59.592494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51693135-e3ac-48ac-85c9-43eeb904b193 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:59.593308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51693135-e3ac-48ac-85c9-43eeb904b193 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:59.593781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51693135-e3ac-48ac-85c9-43eeb904b193 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:59.620477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-51693135-e3ac-48ac-85c9-43eeb904b193 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/ips" status: 200 len: 145 microversion: 2.1 time: 0.046542 Jun 20 06:14:59.621305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 203/421] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:14:59 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:02.687957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:02.688766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:02.693205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-91b92945-3132-46a7-8374-47cd639612aa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7895a92e-5b54-411e-948d-2c242f5e5851"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:02.694386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-91b92945-3132-46a7-8374-47cd639612aa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:02.702611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-91b92945-3132-46a7-8374-47cd639612aa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:02.703015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-91b92945-3132-46a7-8374-47cd639612aa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:02.703753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-91b92945-3132-46a7-8374-47cd639612aa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:02.704205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-91b92945-3132-46a7-8374-47cd639612aa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:03.052561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-91b92945-3132-46a7-8374-47cd639612aa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365392 Jun 20 06:15:03.053235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 219/422] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:15:02 2022] POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:10.547251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee93868f-d69d-42b7-9750-f1cedc0e8706 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:10.549686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:10.550315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:10.556103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee93868f-d69d-42b7-9750-f1cedc0e8706 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:10.556548 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee93868f-d69d-42b7-9750-f1cedc0e8706 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:10.615728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee93868f-d69d-42b7-9750-f1cedc0e8706 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Going to try to stop instance {{(pid=117727) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 06:15:10.658879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee93868f-d69d-42b7-9750-f1cedc0e8706 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/action" status: 202 len: 0 microversion: 2.1 time: 0.115124 Jun 20 06:15:10.659552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 204/423] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:15:10 2022] POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:15:10.669619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a7eb0b99-492a-489d-8d23-ceae62a55b39 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:10.670398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a7eb0b99-492a-489d-8d23-ceae62a55b39 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:10.678109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7eb0b99-492a-489d-8d23-ceae62a55b39 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:10.679361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7eb0b99-492a-489d-8d23-ceae62a55b39 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:10.680495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7eb0b99-492a-489d-8d23-ceae62a55b39 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:10.680934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7eb0b99-492a-489d-8d23-ceae62a55b39 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:10.809518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a7eb0b99-492a-489d-8d23-ceae62a55b39 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:10.817757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a7eb0b99-492a-489d-8d23-ceae62a55b39 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.152736 Jun 20 06:15:10.818315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 220/424] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:10 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:11.474625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-892306004", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-447985312", "security_groups": [{"name": "tempest-secgroup-smoke-1692453996"}], "block_device_mapping_v2": [{"uuid": "3e94b42b-6785-4370-a8cd-5cd1badd405f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73f8a5ee-1f30-4c4c-9916-2c898a38860c"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:11.584300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] validate_networks() for [('73f8a5ee-1f30-4c4c-9916-2c898a38860c', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:15:11.836641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-13d9ac79-0dec-4620-a7e3-f2b4f5f10bb5 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:11.837185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-13d9ac79-0dec-4620-a7e3-f2b4f5f10bb5 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:11.843522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13d9ac79-0dec-4620-a7e3-f2b4f5f10bb5 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:11.843973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13d9ac79-0dec-4620-a7e3-f2b4f5f10bb5 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:11.844736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13d9ac79-0dec-4620-a7e3-f2b4f5f10bb5 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:11.845195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13d9ac79-0dec-4620-a7e3-f2b4f5f10bb5 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:12.238966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:15:12.239383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:15:12.240017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:15:12.240417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:15:12.241056 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:15:12.249930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:12.250377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:12.251169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:12.251741 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:12.271445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Getting quotas for project a80966bf28184a9f8e9987632f7c0973. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:12.271741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-13d9ac79-0dec-4620-a7e3-f2b4f5f10bb5 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:12.276807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Getting quotas for user 6f577abe1ada45979d5cb550073ae6a8 and project a80966bf28184a9f8e9987632f7c0973. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:12.280646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-13d9ac79-0dec-4620-a7e3-f2b4f5f10bb5 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.448606 Jun 20 06:15:12.281469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 221/425] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:11 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:12.344997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:15:12.347277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e94b42b-6785-4370-a8cd-5cd1badd405f',volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:15:12.486016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-17ab899d-ebbd-44da-bc6c-42fd1136e2e0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.015382 Jun 20 06:15:12.486763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 205/426] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:15:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:15:12.497219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5e556239-cf79-4565-ab3c-d8410664ac78 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:12.497873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5e556239-cf79-4565-ab3c-d8410664ac78 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:12.554797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5e556239-cf79-4565-ab3c-d8410664ac78 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:12.563211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5e556239-cf79-4565-ab3c-d8410664ac78 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1093 microversion: 2.1 time: 0.069899 Jun 20 06:15:12.563909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 222/427] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:12 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:13.299486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c6675d4e-1562-4cba-a69a-7285416ad243 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:13.300126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c6675d4e-1562-4cba-a69a-7285416ad243 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:13.308597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6675d4e-1562-4cba-a69a-7285416ad243 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:13.309066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6675d4e-1562-4cba-a69a-7285416ad243 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:13.310373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6675d4e-1562-4cba-a69a-7285416ad243 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:13.310819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6675d4e-1562-4cba-a69a-7285416ad243 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:13.451182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c6675d4e-1562-4cba-a69a-7285416ad243 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:13.459114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c6675d4e-1562-4cba-a69a-7285416ad243 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.164367 Jun 20 06:15:13.459719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 206/428] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:13 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:13.581661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f57314ce-3445-401b-a443-d309cbf1b3fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:13.582204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f57314ce-3445-401b-a443-d309cbf1b3fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:13.589987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f57314ce-3445-401b-a443-d309cbf1b3fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:13.590433 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f57314ce-3445-401b-a443-d309cbf1b3fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:13.591527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f57314ce-3445-401b-a443-d309cbf1b3fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:13.591969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f57314ce-3445-401b-a443-d309cbf1b3fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:13.667992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f57314ce-3445-401b-a443-d309cbf1b3fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:13.681308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f57314ce-3445-401b-a443-d309cbf1b3fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1191 microversion: 2.1 time: 0.104185 Jun 20 06:15:13.682696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 223/429] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:13 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:14.477155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b310f905-7ced-4266-9ee9-336519f862b2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:14.477780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b310f905-7ced-4266-9ee9-336519f862b2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:14.484395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b310f905-7ced-4266-9ee9-336519f862b2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:14.485005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b310f905-7ced-4266-9ee9-336519f862b2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:14.486290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b310f905-7ced-4266-9ee9-336519f862b2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:14.486895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b310f905-7ced-4266-9ee9-336519f862b2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:14.692945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b310f905-7ced-4266-9ee9-336519f862b2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:14.703474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ac6f6233-2c77-4987-bc65-25deb598791f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:14.704009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b310f905-7ced-4266-9ee9-336519f862b2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.231243 Jun 20 06:15:14.705057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ac6f6233-2c77-4987-bc65-25deb598791f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:14.716506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac6f6233-2c77-4987-bc65-25deb598791f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:14.717060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac6f6233-2c77-4987-bc65-25deb598791f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:14.718134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac6f6233-2c77-4987-bc65-25deb598791f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:14.718288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 207/430] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:14 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:14.718807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac6f6233-2c77-4987-bc65-25deb598791f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:14.910647 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ac6f6233-2c77-4987-bc65-25deb598791f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:14.918760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ac6f6233-2c77-4987-bc65-25deb598791f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1277 microversion: 2.1 time: 0.223588 Jun 20 06:15:14.919952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 224/431] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:14 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:15.368257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-1b5f0348-a84f-4447-8914-84bdd65543f2 req-34f20260-4e7b-4ab3-9e64-6ed36d28fef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b98adf6-82cd-42e0-b795-1bffcbe0f936", "tag": "cdaf06e6-1942-4236-8f00-52b64279da15"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:15.382794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1b5f0348-a84f-4447-8914-84bdd65543f2 req-34f20260-4e7b-4ab3-9e64-6ed36d28fef7 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:15.383237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1b5f0348-a84f-4447-8914-84bdd65543f2 req-34f20260-4e7b-4ab3-9e64-6ed36d28fef7 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:15.396258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-1b5f0348-a84f-4447-8914-84bdd65543f2 req-34f20260-4e7b-4ab3-9e64-6ed36d28fef7 service nova] Creating event network-changed:cdaf06e6-1942-4236-8f00-52b64279da15 for instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 on hv-cinder-80473 Jun 20 06:15:15.402366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-1b5f0348-a84f-4447-8914-84bdd65543f2 req-34f20260-4e7b-4ab3-9e64-6ed36d28fef7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038750 Jun 20 06:15:15.403157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 208/432] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:15.726303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-566c8554-23d6-4492-841c-13488de7ca3a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:15.727563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-566c8554-23d6-4492-841c-13488de7ca3a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:15.733854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-566c8554-23d6-4492-841c-13488de7ca3a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:15.734318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-566c8554-23d6-4492-841c-13488de7ca3a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:15.735086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-566c8554-23d6-4492-841c-13488de7ca3a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:15.735522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-566c8554-23d6-4492-841c-13488de7ca3a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:15.862122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-566c8554-23d6-4492-841c-13488de7ca3a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:15.870691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-566c8554-23d6-4492-841c-13488de7ca3a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.148722 Jun 20 06:15:15.871183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 225/433] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:15 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:15.936809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ae9947ad-7329-4ba4-8656-967eaa719ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:15.937531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ae9947ad-7329-4ba4-8656-967eaa719ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:15.943723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae9947ad-7329-4ba4-8656-967eaa719ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:15.944269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae9947ad-7329-4ba4-8656-967eaa719ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:15.945022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae9947ad-7329-4ba4-8656-967eaa719ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:15.945479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae9947ad-7329-4ba4-8656-967eaa719ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:16.081660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ae9947ad-7329-4ba4-8656-967eaa719ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:16.091705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ae9947ad-7329-4ba4-8656-967eaa719ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.159081 Jun 20 06:15:16.092427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 209/434] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:15 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:16.888337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9b4f6cbf-e2ed-48fd-82d7-c053d63115d9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:16.888951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9b4f6cbf-e2ed-48fd-82d7-c053d63115d9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:16.895594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b4f6cbf-e2ed-48fd-82d7-c053d63115d9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:16.896043 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b4f6cbf-e2ed-48fd-82d7-c053d63115d9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:16.896893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b4f6cbf-e2ed-48fd-82d7-c053d63115d9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:16.897445 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b4f6cbf-e2ed-48fd-82d7-c053d63115d9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:17.022866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9b4f6cbf-e2ed-48fd-82d7-c053d63115d9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:17.030654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9b4f6cbf-e2ed-48fd-82d7-c053d63115d9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.146175 Jun 20 06:15:17.031208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 226/435] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:16 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:17.108637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-43c9918a-af28-4c20-b915-606a39f47907 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:17.109197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-43c9918a-af28-4c20-b915-606a39f47907 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:17.116395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43c9918a-af28-4c20-b915-606a39f47907 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:17.116868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43c9918a-af28-4c20-b915-606a39f47907 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:17.117658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43c9918a-af28-4c20-b915-606a39f47907 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:17.118156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43c9918a-af28-4c20-b915-606a39f47907 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:17.246068 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43c9918a-af28-4c20-b915-606a39f47907 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:17.253606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-43c9918a-af28-4c20-b915-606a39f47907 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.148688 Jun 20 06:15:17.254177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 210/436] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:17 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:18.047569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ec56c8ad-918d-44b7-b610-5bb8064b0822 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:18.048178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ec56c8ad-918d-44b7-b610-5bb8064b0822 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:18.055071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec56c8ad-918d-44b7-b610-5bb8064b0822 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:18.055516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec56c8ad-918d-44b7-b610-5bb8064b0822 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:18.056303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec56c8ad-918d-44b7-b610-5bb8064b0822 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:18.056737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec56c8ad-918d-44b7-b610-5bb8064b0822 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:18.189290 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ec56c8ad-918d-44b7-b610-5bb8064b0822 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:18.197698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ec56c8ad-918d-44b7-b610-5bb8064b0822 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.153933 Jun 20 06:15:18.198264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 227/437] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:18 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:18.271218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-71b92a29-4643-4856-9ad6-b056e46ac0a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:18.271800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-71b92a29-4643-4856-9ad6-b056e46ac0a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:18.278253 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71b92a29-4643-4856-9ad6-b056e46ac0a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:18.278696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71b92a29-4643-4856-9ad6-b056e46ac0a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:18.279446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71b92a29-4643-4856-9ad6-b056e46ac0a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:18.279877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71b92a29-4643-4856-9ad6-b056e46ac0a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:18.410337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-71b92a29-4643-4856-9ad6-b056e46ac0a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:18.419156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-71b92a29-4643-4856-9ad6-b056e46ac0a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.152104 Jun 20 06:15:18.428554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 211/438] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:18 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:19.213790 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ff13daaf-751a-4991-8119-b692f1530d37 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:19.214392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ff13daaf-751a-4991-8119-b692f1530d37 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:19.220998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ff13daaf-751a-4991-8119-b692f1530d37 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:19.221510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ff13daaf-751a-4991-8119-b692f1530d37 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:19.222277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ff13daaf-751a-4991-8119-b692f1530d37 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:19.222754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ff13daaf-751a-4991-8119-b692f1530d37 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:19.360733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ff13daaf-751a-4991-8119-b692f1530d37 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:19.369287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ff13daaf-751a-4991-8119-b692f1530d37 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.159199 Jun 20 06:15:19.369988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 228/439] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:19 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:19.435855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-225e40c7-1d56-4b3a-935f-2ac6242c478a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:19.436902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-225e40c7-1d56-4b3a-935f-2ac6242c478a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:19.442869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-225e40c7-1d56-4b3a-935f-2ac6242c478a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:19.443320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-225e40c7-1d56-4b3a-935f-2ac6242c478a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:19.444657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-225e40c7-1d56-4b3a-935f-2ac6242c478a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:19.445087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-225e40c7-1d56-4b3a-935f-2ac6242c478a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:19.584252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-225e40c7-1d56-4b3a-935f-2ac6242c478a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:19.591660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-225e40c7-1d56-4b3a-935f-2ac6242c478a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.159560 Jun 20 06:15:19.592234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 212/440] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:19 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:20.387091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-52351cf1-2c4e-46fc-9981-464659f9e9d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:20.387704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-52351cf1-2c4e-46fc-9981-464659f9e9d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:20.394143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52351cf1-2c4e-46fc-9981-464659f9e9d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:20.394591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52351cf1-2c4e-46fc-9981-464659f9e9d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:20.395605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52351cf1-2c4e-46fc-9981-464659f9e9d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:20.396044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52351cf1-2c4e-46fc-9981-464659f9e9d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:20.524157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-52351cf1-2c4e-46fc-9981-464659f9e9d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:20.531961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-52351cf1-2c4e-46fc-9981-464659f9e9d0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1721 microversion: 2.1 time: 0.148720 Jun 20 06:15:20.532524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 229/441] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:20 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:20.608786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d80f519-27e6-4e02-ac86-3d1f1ce206ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:20.609403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d80f519-27e6-4e02-ac86-3d1f1ce206ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:20.616493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d80f519-27e6-4e02-ac86-3d1f1ce206ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:20.616943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d80f519-27e6-4e02-ac86-3d1f1ce206ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:20.617737 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d80f519-27e6-4e02-ac86-3d1f1ce206ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:20.618172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d80f519-27e6-4e02-ac86-3d1f1ce206ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:20.747926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d80f519-27e6-4e02-ac86-3d1f1ce206ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:20.755268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d80f519-27e6-4e02-ac86-3d1f1ce206ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.150238 Jun 20 06:15:20.755827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 213/442] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:20 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:21.549144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-be4eae46-0058-4df1-a669-c20cab68bdba tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:21.549786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-be4eae46-0058-4df1-a669-c20cab68bdba tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:21.556329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be4eae46-0058-4df1-a669-c20cab68bdba tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.556779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be4eae46-0058-4df1-a669-c20cab68bdba tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:21.557584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be4eae46-0058-4df1-a669-c20cab68bdba tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.558054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be4eae46-0058-4df1-a669-c20cab68bdba tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:21.691487 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-be4eae46-0058-4df1-a669-c20cab68bdba tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:21.699902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-be4eae46-0058-4df1-a669-c20cab68bdba tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1698 microversion: 2.1 time: 0.154596 Jun 20 06:15:21.700465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 230/443] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:21 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:21.715866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d405132d-77ce-4074-a487-d093143be4bc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:21.722351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d405132d-77ce-4074-a487-d093143be4bc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.722796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d405132d-77ce-4074-a487-d093143be4bc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:21.744431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d405132d-77ce-4074-a487-d093143be4bc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Going to try to start instance {{(pid=117727) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 06:15:21.772805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bfd8cefc-f592-4169-ae04-7213d7b6ebf4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:21.773448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bfd8cefc-f592-4169-ae04-7213d7b6ebf4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:21.779426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfd8cefc-f592-4169-ae04-7213d7b6ebf4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.779894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfd8cefc-f592-4169-ae04-7213d7b6ebf4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:21.780690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfd8cefc-f592-4169-ae04-7213d7b6ebf4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.781276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfd8cefc-f592-4169-ae04-7213d7b6ebf4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:21.787993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d405132d-77ce-4074-a487-d093143be4bc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/action" status: 202 len: 0 microversion: 2.1 time: 0.075104 Jun 20 06:15:21.788684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 214/444] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:15:21 2022] POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:15:21.796898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-12c168fa-1a55-48a0-8702-aa90a0126f91 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:21.797631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-12c168fa-1a55-48a0-8702-aa90a0126f91 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:21.804634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12c168fa-1a55-48a0-8702-aa90a0126f91 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.805093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12c168fa-1a55-48a0-8702-aa90a0126f91 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:21.806134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12c168fa-1a55-48a0-8702-aa90a0126f91 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.806544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12c168fa-1a55-48a0-8702-aa90a0126f91 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:21.992797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bfd8cefc-f592-4169-ae04-7213d7b6ebf4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:21.999294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-12c168fa-1a55-48a0-8702-aa90a0126f91 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:22.000498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bfd8cefc-f592-4169-ae04-7213d7b6ebf4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.232373 Jun 20 06:15:22.001181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 231/445] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:21 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:22.007459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-12c168fa-1a55-48a0-8702-aa90a0126f91 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.214546 Jun 20 06:15:22.008021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 215/446] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:21 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:23.017494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6f99e6bc-284a-42b7-9cab-ddaf22191977 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:23.018104 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6f99e6bc-284a-42b7-9cab-ddaf22191977 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:23.020888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:23.024631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fbaba2d4-dac8-4364-b16b-9accfd70023b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:23.025291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fbaba2d4-dac8-4364-b16b-9accfd70023b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:23.026686 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f99e6bc-284a-42b7-9cab-ddaf22191977 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:23.027198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f99e6bc-284a-42b7-9cab-ddaf22191977 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:23.027314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:23.027910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:23.028015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f99e6bc-284a-42b7-9cab-ddaf22191977 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:23.028485 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f99e6bc-284a-42b7-9cab-ddaf22191977 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:23.034085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbaba2d4-dac8-4364-b16b-9accfd70023b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:23.034541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbaba2d4-dac8-4364-b16b-9accfd70023b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:23.035324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbaba2d4-dac8-4364-b16b-9accfd70023b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:23.035764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbaba2d4-dac8-4364-b16b-9accfd70023b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:23.220278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6f99e6bc-284a-42b7-9cab-ddaf22191977 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:23.229080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6f99e6bc-284a-42b7-9cab-ddaf22191977 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.215297 Jun 20 06:15:23.229715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 232/447] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:23 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:23.235087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fbaba2d4-dac8-4364-b16b-9accfd70023b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:23.243334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fbaba2d4-dac8-4364-b16b-9accfd70023b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.223441 Jun 20 06:15:23.243883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 216/448] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:23 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:24.247330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6ddf8b17-3319-4d25-b9b7-fc336a1bc989 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:24.248188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6ddf8b17-3319-4d25-b9b7-fc336a1bc989 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:24.255307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ddf8b17-3319-4d25-b9b7-fc336a1bc989 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:24.255816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ddf8b17-3319-4d25-b9b7-fc336a1bc989 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:24.256645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ddf8b17-3319-4d25-b9b7-fc336a1bc989 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:24.257089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ddf8b17-3319-4d25-b9b7-fc336a1bc989 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:24.260474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-55318303-6bcb-456c-b175-ec0f24a4cabc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:24.261089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-55318303-6bcb-456c-b175-ec0f24a4cabc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:24.267634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55318303-6bcb-456c-b175-ec0f24a4cabc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:24.268085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55318303-6bcb-456c-b175-ec0f24a4cabc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:24.268851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55318303-6bcb-456c-b175-ec0f24a4cabc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:24.269284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55318303-6bcb-456c-b175-ec0f24a4cabc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:24.463162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6ddf8b17-3319-4d25-b9b7-fc336a1bc989 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:24.466284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-55318303-6bcb-456c-b175-ec0f24a4cabc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:24.470600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6ddf8b17-3319-4d25-b9b7-fc336a1bc989 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.227928 Jun 20 06:15:24.471249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 233/449] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:24 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:24.474225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-55318303-6bcb-456c-b175-ec0f24a4cabc tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.217982 Jun 20 06:15:24.475347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 217/450] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:24 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:25.487929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-93675cb5-a14f-4121-9843-4428c551fb58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:25.488541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-93675cb5-a14f-4121-9843-4428c551fb58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:25.492300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2639d7f9-d883-404a-98c7-3cab3a090e3c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:25.492915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2639d7f9-d883-404a-98c7-3cab3a090e3c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:25.495882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93675cb5-a14f-4121-9843-4428c551fb58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:25.496338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93675cb5-a14f-4121-9843-4428c551fb58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:25.497111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93675cb5-a14f-4121-9843-4428c551fb58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:25.497582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93675cb5-a14f-4121-9843-4428c551fb58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:25.499280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2639d7f9-d883-404a-98c7-3cab3a090e3c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:25.499869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2639d7f9-d883-404a-98c7-3cab3a090e3c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:25.500491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2639d7f9-d883-404a-98c7-3cab3a090e3c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:25.500931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2639d7f9-d883-404a-98c7-3cab3a090e3c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:25.698262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-93675cb5-a14f-4121-9843-4428c551fb58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:25.700977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2639d7f9-d883-404a-98c7-3cab3a090e3c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:25.705686 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-93675cb5-a14f-4121-9843-4428c551fb58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.221487 Jun 20 06:15:25.706248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 234/451] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:25 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:25.709897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2639d7f9-d883-404a-98c7-3cab3a090e3c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.221652 Jun 20 06:15:25.710466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 218/452] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:25 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:26.722820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3c2a4f14-6946-4f18-99ff-44156f29d0e8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:26.723462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3c2a4f14-6946-4f18-99ff-44156f29d0e8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:26.727642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5115e681-d080-479d-9c78-bcc6d279f88f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:26.728255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5115e681-d080-479d-9c78-bcc6d279f88f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:26.730114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c2a4f14-6946-4f18-99ff-44156f29d0e8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:26.730560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c2a4f14-6946-4f18-99ff-44156f29d0e8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:26.731331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c2a4f14-6946-4f18-99ff-44156f29d0e8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:26.731763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c2a4f14-6946-4f18-99ff-44156f29d0e8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:26.734327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5115e681-d080-479d-9c78-bcc6d279f88f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:26.734778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5115e681-d080-479d-9c78-bcc6d279f88f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:26.735535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5115e681-d080-479d-9c78-bcc6d279f88f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:26.735786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:26.735973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5115e681-d080-479d-9c78-bcc6d279f88f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:26.933391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3c2a4f14-6946-4f18-99ff-44156f29d0e8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:26.936753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5115e681-d080-479d-9c78-bcc6d279f88f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:26.940266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:26.940854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3c2a4f14-6946-4f18-99ff-44156f29d0e8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.221936 Jun 20 06:15:26.941484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 235/453] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:26 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:26.946015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5115e681-d080-479d-9c78-bcc6d279f88f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.223074 Jun 20 06:15:26.946574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 219/454] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:26 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:27.957628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-43b92d84-77eb-47d4-8071-8ceca88d3b18 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:27.958170 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-43b92d84-77eb-47d4-8071-8ceca88d3b18 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:27.963675 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a22e03f6-f2eb-4e24-9ccc-8f13a8d25d80 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:27.964282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a22e03f6-f2eb-4e24-9ccc-8f13a8d25d80 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:27.966364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43b92d84-77eb-47d4-8071-8ceca88d3b18 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:27.966809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43b92d84-77eb-47d4-8071-8ceca88d3b18 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:27.967582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43b92d84-77eb-47d4-8071-8ceca88d3b18 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:27.968056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43b92d84-77eb-47d4-8071-8ceca88d3b18 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:27.971368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a22e03f6-f2eb-4e24-9ccc-8f13a8d25d80 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:27.971800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a22e03f6-f2eb-4e24-9ccc-8f13a8d25d80 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:27.972560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a22e03f6-f2eb-4e24-9ccc-8f13a8d25d80 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:27.972992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a22e03f6-f2eb-4e24-9ccc-8f13a8d25d80 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:28.161522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-43b92d84-77eb-47d4-8071-8ceca88d3b18 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:28.165803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a22e03f6-f2eb-4e24-9ccc-8f13a8d25d80 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:28.169096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-43b92d84-77eb-47d4-8071-8ceca88d3b18 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.215365 Jun 20 06:15:28.169696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 236/455] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:27 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:28.173838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a22e03f6-f2eb-4e24-9ccc-8f13a8d25d80 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.215179 Jun 20 06:15:28.174392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 220/456] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:27 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:29.186600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-03fb9cf5-c94c-4456-9cb1-d822a50d3421 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:29.187208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-03fb9cf5-c94c-4456-9cb1-d822a50d3421 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:29.191185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1508e0d8-fc02-45db-b271-cac085e01e35 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:29.191796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1508e0d8-fc02-45db-b271-cac085e01e35 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:29.193694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03fb9cf5-c94c-4456-9cb1-d822a50d3421 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:29.194137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03fb9cf5-c94c-4456-9cb1-d822a50d3421 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:29.194894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03fb9cf5-c94c-4456-9cb1-d822a50d3421 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:29.195319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03fb9cf5-c94c-4456-9cb1-d822a50d3421 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:29.200264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1508e0d8-fc02-45db-b271-cac085e01e35 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:29.200264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1508e0d8-fc02-45db-b271-cac085e01e35 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:29.200264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1508e0d8-fc02-45db-b271-cac085e01e35 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:29.200591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1508e0d8-fc02-45db-b271-cac085e01e35 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:29.395387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-03fb9cf5-c94c-4456-9cb1-d822a50d3421 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:29.399437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1508e0d8-fc02-45db-b271-cac085e01e35 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:29.404336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-03fb9cf5-c94c-4456-9cb1-d822a50d3421 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.221598 Jun 20 06:15:29.404904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 237/457] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:29 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:29.407504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1508e0d8-fc02-45db-b271-cac085e01e35 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.220108 Jun 20 06:15:29.408060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 221/458] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:29 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:30.421465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-563e5dab-0876-4944-ad21-5436891ec282 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:30.422331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-563e5dab-0876-4944-ad21-5436891ec282 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:30.423760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fedbdde9-a0fa-4cac-90de-0ed06916d1e6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:30.424376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fedbdde9-a0fa-4cac-90de-0ed06916d1e6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:30.429364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-563e5dab-0876-4944-ad21-5436891ec282 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:30.429839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-563e5dab-0876-4944-ad21-5436891ec282 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:30.430602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-563e5dab-0876-4944-ad21-5436891ec282 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:30.431033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-563e5dab-0876-4944-ad21-5436891ec282 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:30.431138 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fedbdde9-a0fa-4cac-90de-0ed06916d1e6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:30.431486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fedbdde9-a0fa-4cac-90de-0ed06916d1e6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:30.432258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fedbdde9-a0fa-4cac-90de-0ed06916d1e6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:30.432701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fedbdde9-a0fa-4cac-90de-0ed06916d1e6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:30.630377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fedbdde9-a0fa-4cac-90de-0ed06916d1e6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:30.634275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-563e5dab-0876-4944-ad21-5436891ec282 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:30.638883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fedbdde9-a0fa-4cac-90de-0ed06916d1e6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.219000 Jun 20 06:15:30.639694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 222/459] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:30 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:30.642098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-563e5dab-0876-4944-ad21-5436891ec282 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.225000 Jun 20 06:15:30.642654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 238/460] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:30 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:31.657367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-241d3997-4cf5-476a-b5d4-e5371cca9651 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:31.657993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-241d3997-4cf5-476a-b5d4-e5371cca9651 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:31.659659 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4a487a58-0433-4f0e-9c6b-c42f4a5910a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:31.660340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4a487a58-0433-4f0e-9c6b-c42f4a5910a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:31.665123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-241d3997-4cf5-476a-b5d4-e5371cca9651 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:31.665633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-241d3997-4cf5-476a-b5d4-e5371cca9651 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:31.666458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-241d3997-4cf5-476a-b5d4-e5371cca9651 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:31.666879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-241d3997-4cf5-476a-b5d4-e5371cca9651 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:31.667693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a487a58-0433-4f0e-9c6b-c42f4a5910a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:31.668147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a487a58-0433-4f0e-9c6b-c42f4a5910a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:31.668921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a487a58-0433-4f0e-9c6b-c42f4a5910a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:31.669395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a487a58-0433-4f0e-9c6b-c42f4a5910a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:31.860687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-241d3997-4cf5-476a-b5d4-e5371cca9651 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:31.875999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-241d3997-4cf5-476a-b5d4-e5371cca9651 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1707 microversion: 2.1 time: 0.220378 Jun 20 06:15:31.878675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a487a58-0433-4f0e-9c6b-c42f4a5910a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:31.879213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 223/461] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:31 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1707 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:31.894363 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4a487a58-0433-4f0e-9c6b-c42f4a5910a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.238591 Jun 20 06:15:31.898169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 239/462] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:31 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:32.099520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-20f7cdea-0d12-4c4d-9354-1002160cc938 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:32.100010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-20f7cdea-0d12-4c4d-9354-1002160cc938 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:32.105870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20f7cdea-0d12-4c4d-9354-1002160cc938 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:32.106315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20f7cdea-0d12-4c4d-9354-1002160cc938 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:32.107078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20f7cdea-0d12-4c4d-9354-1002160cc938 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:32.107505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20f7cdea-0d12-4c4d-9354-1002160cc938 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:32.130404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-20f7cdea-0d12-4c4d-9354-1002160cc938 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/ips" status: 200 len: 150 microversion: 2.1 time: 0.034678 Jun 20 06:15:32.131549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 224/463] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:15:32 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:32.893573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a00d14b1-0e01-40b0-a749-6cca297948ef tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:32.894188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a00d14b1-0e01-40b0-a749-6cca297948ef tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:32.897229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=45 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:32.902536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a00d14b1-0e01-40b0-a749-6cca297948ef tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:32.902982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a00d14b1-0e01-40b0-a749-6cca297948ef tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:32.903740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a00d14b1-0e01-40b0-a749-6cca297948ef tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:32.904174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a00d14b1-0e01-40b0-a749-6cca297948ef tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:32.913925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-90591696-524d-448c-bc8d-f64729298022 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:32.914528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-90591696-524d-448c-bc8d-f64729298022 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:32.920999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-90591696-524d-448c-bc8d-f64729298022 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:32.921477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-90591696-524d-448c-bc8d-f64729298022 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:32.922249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-90591696-524d-448c-bc8d-f64729298022 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:32.922690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-90591696-524d-448c-bc8d-f64729298022 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:33.108182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a00d14b1-0e01-40b0-a749-6cca297948ef tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:33.116103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a00d14b1-0e01-40b0-a749-6cca297948ef tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1711 microversion: 2.1 time: 0.226567 Jun 20 06:15:33.116743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-90591696-524d-448c-bc8d-f64729298022 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:33.121751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 240/464] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:32 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1711 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:33.125412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-90591696-524d-448c-bc8d-f64729298022 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.215883 Jun 20 06:15:33.126093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 225/465] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:32 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:34.142638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-73aae30a-1380-4c7f-bb64-bebfb477a1d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:34.143247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-73aae30a-1380-4c7f-bb64-bebfb477a1d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:34.150241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73aae30a-1380-4c7f-bb64-bebfb477a1d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:34.150692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73aae30a-1380-4c7f-bb64-bebfb477a1d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:34.151450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73aae30a-1380-4c7f-bb64-bebfb477a1d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:34.151889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73aae30a-1380-4c7f-bb64-bebfb477a1d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:34.284271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-73aae30a-1380-4c7f-bb64-bebfb477a1d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:34.291909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-73aae30a-1380-4c7f-bb64-bebfb477a1d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.153168 Jun 20 06:15:34.292453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 241/466] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:34 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:35.308026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a40c863e-50b4-4935-89e4-446ec33da54c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:35.308551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a40c863e-50b4-4935-89e4-446ec33da54c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:35.315098 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a40c863e-50b4-4935-89e4-446ec33da54c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:35.315543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a40c863e-50b4-4935-89e4-446ec33da54c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:35.316299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a40c863e-50b4-4935-89e4-446ec33da54c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:35.316731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a40c863e-50b4-4935-89e4-446ec33da54c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:35.454475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a40c863e-50b4-4935-89e4-446ec33da54c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:35.462333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a40c863e-50b4-4935-89e4-446ec33da54c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.158171 Jun 20 06:15:35.462910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 226/467] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:35 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:36.480083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4e741709-9c27-4224-97c1-426c8b89ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:36.480769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4e741709-9c27-4224-97c1-426c8b89ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:36.487715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e741709-9c27-4224-97c1-426c8b89ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:36.488171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e741709-9c27-4224-97c1-426c8b89ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:36.488946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e741709-9c27-4224-97c1-426c8b89ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:36.489411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e741709-9c27-4224-97c1-426c8b89ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:36.624946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4e741709-9c27-4224-97c1-426c8b89ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:36.632880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4e741709-9c27-4224-97c1-426c8b89ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.157619 Jun 20 06:15:36.633450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 242/468] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:36 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:37.650369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ed73324c-0bbb-4860-9ae0-e3671ff63762 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:37.650984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ed73324c-0bbb-4860-9ae0-e3671ff63762 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:37.658363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed73324c-0bbb-4860-9ae0-e3671ff63762 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:37.658822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed73324c-0bbb-4860-9ae0-e3671ff63762 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:37.659598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed73324c-0bbb-4860-9ae0-e3671ff63762 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:37.660048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed73324c-0bbb-4860-9ae0-e3671ff63762 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:37.766178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-979fd226-d04b-42d8-9ea5-5415cb013d9e req-40a79b58-7fa3-4108-b67d-98c90de5b31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98adf6-82cd-42e0-b795-1bffcbe0f936", "name": "network-vif-plugged", "status": "completed", "tag": "cdaf06e6-1942-4236-8f00-52b64279da15"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:37.775921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-979fd226-d04b-42d8-9ea5-5415cb013d9e req-40a79b58-7fa3-4108-b67d-98c90de5b31e service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:37.776480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-979fd226-d04b-42d8-9ea5-5415cb013d9e req-40a79b58-7fa3-4108-b67d-98c90de5b31e service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:37.789331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-979fd226-d04b-42d8-9ea5-5415cb013d9e req-40a79b58-7fa3-4108-b67d-98c90de5b31e service nova] Creating event network-vif-plugged:cdaf06e6-1942-4236-8f00-52b64279da15 for instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 on hv-cinder-80473 Jun 20 06:15:37.797059 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ed73324c-0bbb-4860-9ae0-e3671ff63762 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:37.800908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-979fd226-d04b-42d8-9ea5-5415cb013d9e req-40a79b58-7fa3-4108-b67d-98c90de5b31e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Jun 20 06:15:37.801639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 243/469] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:15:37.806427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ed73324c-0bbb-4860-9ae0-e3671ff63762 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.159998 Jun 20 06:15:37.807065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 227/470] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:37 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:38.739310 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cefcd200-3e2d-4f7d-8f76-df7107c67e18 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d828c039-6fb0-48ad-b274-0b625d720c77"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:38.740973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cefcd200-3e2d-4f7d-8f76-df7107c67e18 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:38.747430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cefcd200-3e2d-4f7d-8f76-df7107c67e18 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.747956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cefcd200-3e2d-4f7d-8f76-df7107c67e18 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.748798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cefcd200-3e2d-4f7d-8f76-df7107c67e18 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.749359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cefcd200-3e2d-4f7d-8f76-df7107c67e18 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.823651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f5ae587-da6c-4167-a653-2f9b0110c5c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:38.824286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f5ae587-da6c-4167-a653-2f9b0110c5c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:38.831442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f5ae587-da6c-4167-a653-2f9b0110c5c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.831794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f5ae587-da6c-4167-a653-2f9b0110c5c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.832584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f5ae587-da6c-4167-a653-2f9b0110c5c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.833021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f5ae587-da6c-4167-a653-2f9b0110c5c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.963646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f5ae587-da6c-4167-a653-2f9b0110c5c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:38.971363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f5ae587-da6c-4167-a653-2f9b0110c5c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1265 microversion: 2.1 time: 0.151659 Jun 20 06:15:38.971953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 228/471] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:38 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:39.544833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cefcd200-3e2d-4f7d-8f76-df7107c67e18 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.809634 Jun 20 06:15:39.545481 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 244/472] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:15:38 2022] POST /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:39.987903 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-80b0a3e4-18da-4d39-a276-74787c8b5126 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:39.988572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-80b0a3e4-18da-4d39-a276-74787c8b5126 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:39.995291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80b0a3e4-18da-4d39-a276-74787c8b5126 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.995745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80b0a3e4-18da-4d39-a276-74787c8b5126 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:39.996517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80b0a3e4-18da-4d39-a276-74787c8b5126 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.996954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80b0a3e4-18da-4d39-a276-74787c8b5126 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:40.132870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-80b0a3e4-18da-4d39-a276-74787c8b5126 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:40.140492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-80b0a3e4-18da-4d39-a276-74787c8b5126 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1453 microversion: 2.1 time: 0.156410 Jun 20 06:15:40.141058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 229/473] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:39 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:40.158529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-66bccc4a-b4b9-4dff-9010-3f18c61bce1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:40.159168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-66bccc4a-b4b9-4dff-9010-3f18c61bce1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:40.165793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66bccc4a-b4b9-4dff-9010-3f18c61bce1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:40.166241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66bccc4a-b4b9-4dff-9010-3f18c61bce1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:40.167000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66bccc4a-b4b9-4dff-9010-3f18c61bce1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:40.167431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66bccc4a-b4b9-4dff-9010-3f18c61bce1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:40.306641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-66bccc4a-b4b9-4dff-9010-3f18c61bce1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:40.314080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-66bccc4a-b4b9-4dff-9010-3f18c61bce1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1453 microversion: 2.1 time: 0.160631 Jun 20 06:15:40.315734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 245/474] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:40 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:42.069460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-673d757a-3bd4-473e-8723-6fb9e4a4244a req-a1a88170-3376-470d-96ca-bfee39e684e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b98adf6-82cd-42e0-b795-1bffcbe0f936", "tag": "cdaf06e6-1942-4236-8f00-52b64279da15"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:42.075023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:42.079566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-673d757a-3bd4-473e-8723-6fb9e4a4244a req-a1a88170-3376-470d-96ca-bfee39e684e8 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:42.080309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-673d757a-3bd4-473e-8723-6fb9e4a4244a req-a1a88170-3376-470d-96ca-bfee39e684e8 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:42.094224 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-673d757a-3bd4-473e-8723-6fb9e4a4244a req-a1a88170-3376-470d-96ca-bfee39e684e8 service nova] Creating event network-changed:cdaf06e6-1942-4236-8f00-52b64279da15 for instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 on hv-cinder-80473 Jun 20 06:15:42.100585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-673d757a-3bd4-473e-8723-6fb9e4a4244a req-a1a88170-3376-470d-96ca-bfee39e684e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035068 Jun 20 06:15:42.101195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 230/475] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:47.044124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-59d800fc-6009-4e45-9ef5-9b264ad722de tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: .version_select at 0x7f7a7a707310>, body: {"keypair": {"name": "tempest-keypair-1346049991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV0x1cWHOUpU3Gh0Zvv2gYuvCAmPcxNZw+aCirPrDMWvrHfsPR4te+VHi7BN+AD8SDGYr6kqpye0QQuEsSVzWj5Ew8pbnOQWaISbl6WZTRhgW3/4xJh4kBsPA+DPKV7Kw=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:47.058445 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-59d800fc-6009-4e45-9ef5-9b264ad722de tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for project fde00bac11024d898d6d87b8d2abc29e. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:47.062145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-59d800fc-6009-4e45-9ef5-9b264ad722de tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for user ee7405c2b1504907ba919e2797e63754 and project fde00bac11024d898d6d87b8d2abc29e. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:47.088233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-59d800fc-6009-4e45-9ef5-9b264ad722de tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047843 Jun 20 06:15:47.089149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 246/476] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:15:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:48.547399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1893637671", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9962bf9-afc3-4bca-900b-7a55dc02f894"}], "security_groups": [{"name": "tempest-securitygroup--1079280085"}], "key_name": "tempest-keypair-1346049991", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:48.651265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] validate_networks() for [('e9962bf9-afc3-4bca-900b-7a55dc02f894', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:15:49.011666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:15:49.012090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:15:49.012567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:15:49.013012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:15:49.013458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:15:49.022689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.023139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.023947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.024385 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.044703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for project fde00bac11024d898d6d87b8d2abc29e. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:49.048705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for user ee7405c2b1504907ba919e2797e63754 and project fde00bac11024d898d6d87b8d2abc29e. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:49.060382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:15:49.062796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:15:49.107522 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b0a2a68f-4f3b-459d-874b-da4eb270d907 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564996 Jun 20 06:15:49.108159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 231/477] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:15:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:15:49.118546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db429d0d-a18e-4514-956f-d05bbc860eae tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:49.119159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-db429d0d-a18e-4514-956f-d05bbc860eae tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:49.174486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-db429d0d-a18e-4514-956f-d05bbc860eae tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:49.182394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-db429d0d-a18e-4514-956f-d05bbc860eae tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1242 microversion: 2.1 time: 0.068136 Jun 20 06:15:49.183654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 247/478] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:49 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:50.200442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1fd4c28b-f10d-467e-9147-308ce78b48bc tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:50.201786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1fd4c28b-f10d-467e-9147-308ce78b48bc tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:50.208371 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fd4c28b-f10d-467e-9147-308ce78b48bc tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.208823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fd4c28b-f10d-467e-9147-308ce78b48bc tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.209910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fd4c28b-f10d-467e-9147-308ce78b48bc tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.210353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fd4c28b-f10d-467e-9147-308ce78b48bc tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.280820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1fd4c28b-f10d-467e-9147-308ce78b48bc tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:50.288717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1fd4c28b-f10d-467e-9147-308ce78b48bc tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1302 microversion: 2.1 time: 0.091837 Jun 20 06:15:50.289554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 232/479] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:50 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:51.303938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:51.317597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1c1b1bfa-0973-431d-86d9-9531ccb6eb38 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:51.318273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1c1b1bfa-0973-431d-86d9-9531ccb6eb38 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:51.333542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c1b1bfa-0973-431d-86d9-9531ccb6eb38 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.333993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c1b1bfa-0973-431d-86d9-9531ccb6eb38 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.335556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c1b1bfa-0973-431d-86d9-9531ccb6eb38 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.336147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c1b1bfa-0973-431d-86d9-9531ccb6eb38 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.481083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c1b1bfa-0973-431d-86d9-9531ccb6eb38 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.491697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1c1b1bfa-0973-431d-86d9-9531ccb6eb38 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1368 microversion: 2.1 time: 0.189317 Jun 20 06:15:51.501447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 248/480] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:51 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:51.744570 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-a5a82525-e227-4663-bdce-bee94b4bc275 req-393e6f24-5b38-4cea-ac84-8106a64da68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1", "tag": "3773a194-19ba-4ab8-aba8-914fd70f064c"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:51.753409 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a5a82525-e227-4663-bdce-bee94b4bc275 req-393e6f24-5b38-4cea-ac84-8106a64da68e service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.753914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a5a82525-e227-4663-bdce-bee94b4bc275 req-393e6f24-5b38-4cea-ac84-8106a64da68e service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.770627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-a5a82525-e227-4663-bdce-bee94b4bc275 req-393e6f24-5b38-4cea-ac84-8106a64da68e service nova] Creating event network-changed:3773a194-19ba-4ab8-aba8-914fd70f064c for instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 on hv-cinder-80473 Jun 20 06:15:51.777677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-a5a82525-e227-4663-bdce-bee94b4bc275 req-393e6f24-5b38-4cea-ac84-8106a64da68e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037060 Jun 20 06:15:51.778296 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 233/481] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:52.509327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eb36a008-f37c-4343-addc-391a5b3fd376 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:52.509869 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eb36a008-f37c-4343-addc-391a5b3fd376 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:52.516202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb36a008-f37c-4343-addc-391a5b3fd376 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.516642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb36a008-f37c-4343-addc-391a5b3fd376 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.517400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb36a008-f37c-4343-addc-391a5b3fd376 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.517845 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb36a008-f37c-4343-addc-391a5b3fd376 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.649740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eb36a008-f37c-4343-addc-391a5b3fd376 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:52.657056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eb36a008-f37c-4343-addc-391a5b3fd376 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1368 microversion: 2.1 time: 0.151782 Jun 20 06:15:52.657642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 249/482] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:52 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:53.674948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2673bd41-3bcf-4e7a-a12e-d3682545d9d4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:53.675637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2673bd41-3bcf-4e7a-a12e-d3682545d9d4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:53.682823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2673bd41-3bcf-4e7a-a12e-d3682545d9d4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.683265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2673bd41-3bcf-4e7a-a12e-d3682545d9d4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.684020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2673bd41-3bcf-4e7a-a12e-d3682545d9d4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.684448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2673bd41-3bcf-4e7a-a12e-d3682545d9d4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.814691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2673bd41-3bcf-4e7a-a12e-d3682545d9d4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:53.822814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2673bd41-3bcf-4e7a-a12e-d3682545d9d4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1368 microversion: 2.1 time: 0.151991 Jun 20 06:15:53.823406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 234/483] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:53 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:54.840186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a0584302-d646-44d3-80ca-f147541195b1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:54.840776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a0584302-d646-44d3-80ca-f147541195b1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:54.847137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0584302-d646-44d3-80ca-f147541195b1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.847586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0584302-d646-44d3-80ca-f147541195b1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.848344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0584302-d646-44d3-80ca-f147541195b1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.848778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0584302-d646-44d3-80ca-f147541195b1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.978768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a0584302-d646-44d3-80ca-f147541195b1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:54.986178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a0584302-d646-44d3-80ca-f147541195b1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1368 microversion: 2.1 time: 0.150404 Jun 20 06:15:54.986748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 250/484] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:54 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:56.002302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c2164233-08d2-499a-b705-b6ee6e9c026a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:56.002851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c2164233-08d2-499a-b705-b6ee6e9c026a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:56.009565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2164233-08d2-499a-b705-b6ee6e9c026a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.010018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2164233-08d2-499a-b705-b6ee6e9c026a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.010782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2164233-08d2-499a-b705-b6ee6e9c026a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.011240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2164233-08d2-499a-b705-b6ee6e9c026a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.144416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c2164233-08d2-499a-b705-b6ee6e9c026a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:56.153229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c2164233-08d2-499a-b705-b6ee6e9c026a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1368 microversion: 2.1 time: 0.154732 Jun 20 06:15:56.154519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 235/485] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:55 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:57.170903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-80193702-777f-4453-91c2-5cd68c8ae13b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:57.171511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-80193702-777f-4453-91c2-5cd68c8ae13b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:57.178045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80193702-777f-4453-91c2-5cd68c8ae13b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.178495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80193702-777f-4453-91c2-5cd68c8ae13b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.179753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80193702-777f-4453-91c2-5cd68c8ae13b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.180720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80193702-777f-4453-91c2-5cd68c8ae13b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.307569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-80193702-777f-4453-91c2-5cd68c8ae13b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:57.314941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-80193702-777f-4453-91c2-5cd68c8ae13b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1368 microversion: 2.1 time: 0.147904 Jun 20 06:15:57.315738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 251/486] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:57 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:57.829102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-e54645f3-afd1-4818-8980-4447ae693346 req-1e02e0ab-5f60-4c50-ac08-69192a50f9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1", "name": "network-vif-plugged", "status": "completed", "tag": "3773a194-19ba-4ab8-aba8-914fd70f064c"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:57.839984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-e54645f3-afd1-4818-8980-4447ae693346 req-1e02e0ab-5f60-4c50-ac08-69192a50f9fe service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.840676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-e54645f3-afd1-4818-8980-4447ae693346 req-1e02e0ab-5f60-4c50-ac08-69192a50f9fe service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.852026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-e54645f3-afd1-4818-8980-4447ae693346 req-1e02e0ab-5f60-4c50-ac08-69192a50f9fe service nova] Creating event network-vif-plugged:3773a194-19ba-4ab8-aba8-914fd70f064c for instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 on hv-cinder-80473 Jun 20 06:15:57.857120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-e54645f3-afd1-4818-8980-4447ae693346 req-1e02e0ab-5f60-4c50-ac08-69192a50f9fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031647 Jun 20 06:15:57.857751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 236/487] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:58.332236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-721d3138-06ab-49a4-bfc5-6d23e45db8ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:58.332847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-721d3138-06ab-49a4-bfc5-6d23e45db8ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:58.339412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-721d3138-06ab-49a4-bfc5-6d23e45db8ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.339860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-721d3138-06ab-49a4-bfc5-6d23e45db8ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.340617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-721d3138-06ab-49a4-bfc5-6d23e45db8ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.341053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-721d3138-06ab-49a4-bfc5-6d23e45db8ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.472704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-721d3138-06ab-49a4-bfc5-6d23e45db8ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.480590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-721d3138-06ab-49a4-bfc5-6d23e45db8ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1368 microversion: 2.1 time: 0.152209 Jun 20 06:15:58.481175 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 252/488] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:58 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:59.497878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-737e9d23-bd9d-448b-bf68-153f653ec792 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:59.498572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-737e9d23-bd9d-448b-bf68-153f653ec792 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:59.500964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:59.501643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:59.509462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-737e9d23-bd9d-448b-bf68-153f653ec792 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.509927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-737e9d23-bd9d-448b-bf68-153f653ec792 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.510745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-737e9d23-bd9d-448b-bf68-153f653ec792 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.511178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-737e9d23-bd9d-448b-bf68-153f653ec792 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.515449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=85 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:59.640303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-737e9d23-bd9d-448b-bf68-153f653ec792 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:59.647932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-737e9d23-bd9d-448b-bf68-153f653ec792 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1368 microversion: 2.1 time: 0.154162 Jun 20 06:15:59.648517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 237/489] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:59 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:00.664836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-461f1049-2d8a-4f36-8d10-7a61fbea916e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:00.665530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-461f1049-2d8a-4f36-8d10-7a61fbea916e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:00.667515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:00.673818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-461f1049-2d8a-4f36-8d10-7a61fbea916e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.674277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-461f1049-2d8a-4f36-8d10-7a61fbea916e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.675044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-461f1049-2d8a-4f36-8d10-7a61fbea916e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.675486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-461f1049-2d8a-4f36-8d10-7a61fbea916e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.809992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-461f1049-2d8a-4f36-8d10-7a61fbea916e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:00.817664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-461f1049-2d8a-4f36-8d10-7a61fbea916e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1559 microversion: 2.1 time: 0.156714 Jun 20 06:16:00.818432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 253/490] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:00 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:00.834652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1cc3f334-24c8-4535-a005-3519fc7b6d5d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:00.835181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1cc3f334-24c8-4535-a005-3519fc7b6d5d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:00.842190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1cc3f334-24c8-4535-a005-3519fc7b6d5d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.842636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1cc3f334-24c8-4535-a005-3519fc7b6d5d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.843386 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1cc3f334-24c8-4535-a005-3519fc7b6d5d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.843816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1cc3f334-24c8-4535-a005-3519fc7b6d5d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.922179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1cc3f334-24c8-4535-a005-3519fc7b6d5d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091333 Jun 20 06:16:00.922826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 238/491] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jun 20 06:16:00 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:16:01.832855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-28aac8cb-d969-4136-873e-8412a68cb94d req-c0b66d33-9fd4-4fed-862c-416967edcb65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1", "tag": "3773a194-19ba-4ab8-aba8-914fd70f064c"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:01.842323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-28aac8cb-d969-4136-873e-8412a68cb94d req-c0b66d33-9fd4-4fed-862c-416967edcb65 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.842761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-28aac8cb-d969-4136-873e-8412a68cb94d req-c0b66d33-9fd4-4fed-862c-416967edcb65 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.854521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-28aac8cb-d969-4136-873e-8412a68cb94d req-c0b66d33-9fd4-4fed-862c-416967edcb65 service nova] Creating event network-changed:3773a194-19ba-4ab8-aba8-914fd70f064c for instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 on hv-cinder-80473 Jun 20 06:16:01.859934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-28aac8cb-d969-4136-873e-8412a68cb94d req-c0b66d33-9fd4-4fed-862c-416967edcb65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030535 Jun 20 06:16:01.860871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 254/492] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:17.485732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:16:17.486320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:16:26.183713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:26.184468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=9 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:26.356569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-92914080-e588-4918-9200-4f97a4f6ede6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "545dfaba-e787-4cad-a5e9-feab7b18fe13"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:26.357750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-92914080-e588-4918-9200-4f97a4f6ede6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:26.363716 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92914080-e588-4918-9200-4f97a4f6ede6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.364161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92914080-e588-4918-9200-4f97a4f6ede6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.364922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92914080-e588-4918-9200-4f97a4f6ede6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.365356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92914080-e588-4918-9200-4f97a4f6ede6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.722674 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-92914080-e588-4918-9200-4f97a4f6ede6 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540423 Jun 20 06:16:26.723205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 239/493] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:16:26 2022] POST /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:16:34.207037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:34.207772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=38 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:34.213127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-05e50b5a-e944-45b2-ad0a-60ce0c8a3f4f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:34.214196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-05e50b5a-e944-45b2-ad0a-60ce0c8a3f4f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:34.222053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05e50b5a-e944-45b2-ad0a-60ce0c8a3f4f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:34.222502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05e50b5a-e944-45b2-ad0a-60ce0c8a3f4f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:34.223261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05e50b5a-e944-45b2-ad0a-60ce0c8a3f4f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:34.223695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05e50b5a-e944-45b2-ad0a-60ce0c8a3f4f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:34.246966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-05e50b5a-e944-45b2-ad0a-60ce0c8a3f4f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lazy-loading 'flavor' on Instance uuid c03d50ed-386e-42ee-af59-9a0231218aa2 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:16:34.420225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-05e50b5a-e944-45b2-ad0a-60ce0c8a3f4f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/action" status: 200 len: 32 microversion: 2.1 time: 0.214478 Jun 20 06:16:34.421228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 255/494] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:16:34 2022] POST /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:16:34.432040 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1654fd4d-86a6-4082-a471-b01cc14b0bfa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:34.432845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1654fd4d-86a6-4082-a471-b01cc14b0bfa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:34.440283 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1654fd4d-86a6-4082-a471-b01cc14b0bfa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:34.441074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1654fd4d-86a6-4082-a471-b01cc14b0bfa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:34.442368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1654fd4d-86a6-4082-a471-b01cc14b0bfa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:34.442871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1654fd4d-86a6-4082-a471-b01cc14b0bfa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:34.585797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1654fd4d-86a6-4082-a471-b01cc14b0bfa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:34.594555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1654fd4d-86a6-4082-a471-b01cc14b0bfa tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.167965 Jun 20 06:16:34.595132 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 240/495] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:34 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:35.612943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db4bb4f2-5ac6-45b0-a5ac-eb28f7d92beb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:35.613640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-db4bb4f2-5ac6-45b0-a5ac-eb28f7d92beb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:35.620827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db4bb4f2-5ac6-45b0-a5ac-eb28f7d92beb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:35.621263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db4bb4f2-5ac6-45b0-a5ac-eb28f7d92beb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:35.622039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db4bb4f2-5ac6-45b0-a5ac-eb28f7d92beb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:35.622467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db4bb4f2-5ac6-45b0-a5ac-eb28f7d92beb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:35.755717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-db4bb4f2-5ac6-45b0-a5ac-eb28f7d92beb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:35.764358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-db4bb4f2-5ac6-45b0-a5ac-eb28f7d92beb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.155872 Jun 20 06:16:35.764918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 256/496] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:35 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:36.782347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-846ad630-2476-48e6-afb3-909b51523ddc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:36.782953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-846ad630-2476-48e6-afb3-909b51523ddc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:36.789595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-846ad630-2476-48e6-afb3-909b51523ddc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:36.790044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-846ad630-2476-48e6-afb3-909b51523ddc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:36.790835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-846ad630-2476-48e6-afb3-909b51523ddc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:36.791266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-846ad630-2476-48e6-afb3-909b51523ddc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:36.918847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-846ad630-2476-48e6-afb3-909b51523ddc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:36.926721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-846ad630-2476-48e6-afb3-909b51523ddc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.148231 Jun 20 06:16:36.927286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 241/497] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:36 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:37.943690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a0cf5397-eed0-49b6-9e9e-54df28453b03 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:37.944298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a0cf5397-eed0-49b6-9e9e-54df28453b03 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:37.950844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0cf5397-eed0-49b6-9e9e-54df28453b03 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:37.951290 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0cf5397-eed0-49b6-9e9e-54df28453b03 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:37.952052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0cf5397-eed0-49b6-9e9e-54df28453b03 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:37.952494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0cf5397-eed0-49b6-9e9e-54df28453b03 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:38.080026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a0cf5397-eed0-49b6-9e9e-54df28453b03 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:38.087955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a0cf5397-eed0-49b6-9e9e-54df28453b03 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.148051 Jun 20 06:16:38.088516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 257/498] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:37 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:39.105498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a4edefb0-707a-4b32-bf35-2a021d933583 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:39.106107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a4edefb0-707a-4b32-bf35-2a021d933583 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:39.112525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4edefb0-707a-4b32-bf35-2a021d933583 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:39.112971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4edefb0-707a-4b32-bf35-2a021d933583 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:39.113758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4edefb0-707a-4b32-bf35-2a021d933583 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:39.114194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4edefb0-707a-4b32-bf35-2a021d933583 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:39.247078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a4edefb0-707a-4b32-bf35-2a021d933583 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:39.254892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a4edefb0-707a-4b32-bf35-2a021d933583 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.153886 Jun 20 06:16:39.255453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 242/499] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:39 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:40.242834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4c6e6edd-48df-45fd-8660-d708c297775a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:40.243335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4c6e6edd-48df-45fd-8660-d708c297775a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:40.250173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c6e6edd-48df-45fd-8660-d708c297775a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:40.250618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c6e6edd-48df-45fd-8660-d708c297775a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:40.251375 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c6e6edd-48df-45fd-8660-d708c297775a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:40.251807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c6e6edd-48df-45fd-8660-d708c297775a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:40.273549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-837c6ae8-ce60-47d6-a862-325fc2987cac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:40.274157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-837c6ae8-ce60-47d6-a862-325fc2987cac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:40.280510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-837c6ae8-ce60-47d6-a862-325fc2987cac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:40.280959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-837c6ae8-ce60-47d6-a862-325fc2987cac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:40.281749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-837c6ae8-ce60-47d6-a862-325fc2987cac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:40.282186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-837c6ae8-ce60-47d6-a862-325fc2987cac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:40.380922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-4c6e6edd-48df-45fd-8660-d708c297775a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lazy-loading 'services' on Instance uuid 7697c07f-5fd2-4b76-87af-0cb70746a73e {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:16:40.416902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-837c6ae8-ce60-47d6-a862-325fc2987cac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:40.424832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-837c6ae8-ce60-47d6-a862-325fc2987cac tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.155360 Jun 20 06:16:40.425409 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 243/500] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:40 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:40.500890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4c6e6edd-48df-45fd-8660-d708c297775a tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/os-volume_attachments/7895a92e-5b54-411e-948d-2c242f5e5851" status: 202 len: 0 microversion: 2.1 time: 0.364835 Jun 20 06:16:40.501572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 258/501] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:16:40 2022] DELETE /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/os-volume_attachments/7895a92e-5b54-411e-948d-2c242f5e5851 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:16:41.442146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89567dba-600a-4bd2-acd7-c69eefe7af7a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:41.442670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-89567dba-600a-4bd2-acd7-c69eefe7af7a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:41.449091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89567dba-600a-4bd2-acd7-c69eefe7af7a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:41.449574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89567dba-600a-4bd2-acd7-c69eefe7af7a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:41.450331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89567dba-600a-4bd2-acd7-c69eefe7af7a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:41.450764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89567dba-600a-4bd2-acd7-c69eefe7af7a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:41.595780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-89567dba-600a-4bd2-acd7-c69eefe7af7a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:41.604413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89567dba-600a-4bd2-acd7-c69eefe7af7a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.166334 Jun 20 06:16:41.604944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 244/502] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:41 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:41.626625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bbde1196-bb62-4645-9ed7-40c087505fc4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:41.632857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bbde1196-bb62-4645-9ed7-40c087505fc4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:41.633301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bbde1196-bb62-4645-9ed7-40c087505fc4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:41.692666 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bbde1196-bb62-4645-9ed7-40c087505fc4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Going to try to stop instance {{(pid=117726) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 06:16:41.734144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bbde1196-bb62-4645-9ed7-40c087505fc4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/action" status: 202 len: 0 microversion: 2.1 time: 0.111672 Jun 20 06:16:41.734734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 259/503] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:16:41 2022] POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:16:41.742889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ec6f3e8b-f983-464d-be6d-e2c9133837f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:41.744058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec6f3e8b-f983-464d-be6d-e2c9133837f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:41.750302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec6f3e8b-f983-464d-be6d-e2c9133837f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:41.750808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec6f3e8b-f983-464d-be6d-e2c9133837f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:41.751497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec6f3e8b-f983-464d-be6d-e2c9133837f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:41.751930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec6f3e8b-f983-464d-be6d-e2c9133837f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:41.884668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ec6f3e8b-f983-464d-be6d-e2c9133837f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:41.892314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ec6f3e8b-f983-464d-be6d-e2c9133837f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.153380 Jun 20 06:16:41.892873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 245/504] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:41 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:42.622656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9fc8e0b9-c6f4-43de-afc0-ea77dde55c8f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:42.623270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9fc8e0b9-c6f4-43de-afc0-ea77dde55c8f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:42.629866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9fc8e0b9-c6f4-43de-afc0-ea77dde55c8f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:42.630448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9fc8e0b9-c6f4-43de-afc0-ea77dde55c8f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:42.631053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9fc8e0b9-c6f4-43de-afc0-ea77dde55c8f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:42.631485 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9fc8e0b9-c6f4-43de-afc0-ea77dde55c8f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:42.758865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9fc8e0b9-c6f4-43de-afc0-ea77dde55c8f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:42.767211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9fc8e0b9-c6f4-43de-afc0-ea77dde55c8f tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.149392 Jun 20 06:16:42.767773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 260/505] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:42 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:42.910227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3ca107af-f6e6-4315-9485-505ac3f4dfa2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:42.910874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3ca107af-f6e6-4315-9485-505ac3f4dfa2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:42.917949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ca107af-f6e6-4315-9485-505ac3f4dfa2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:42.918399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ca107af-f6e6-4315-9485-505ac3f4dfa2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:42.919156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ca107af-f6e6-4315-9485-505ac3f4dfa2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:42.919590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ca107af-f6e6-4315-9485-505ac3f4dfa2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:43.048483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3ca107af-f6e6-4315-9485-505ac3f4dfa2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:43.056502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3ca107af-f6e6-4315-9485-505ac3f4dfa2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.149577 Jun 20 06:16:43.056664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 246/506] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:42 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:43.785402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-19bb2adc-f9ae-4666-9852-05892f98ed60 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:43.786013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-19bb2adc-f9ae-4666-9852-05892f98ed60 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:43.793013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19bb2adc-f9ae-4666-9852-05892f98ed60 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:43.793475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19bb2adc-f9ae-4666-9852-05892f98ed60 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:43.794225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19bb2adc-f9ae-4666-9852-05892f98ed60 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:43.794654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19bb2adc-f9ae-4666-9852-05892f98ed60 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:43.921523 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-19bb2adc-f9ae-4666-9852-05892f98ed60 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:43.929433 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-19bb2adc-f9ae-4666-9852-05892f98ed60 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.147870 Jun 20 06:16:43.929939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 261/507] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:43 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:44.073149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eef88993-5c80-4846-a804-d17c9acec71e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:44.073823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eef88993-5c80-4846-a804-d17c9acec71e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:44.080264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eef88993-5c80-4846-a804-d17c9acec71e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:44.080718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eef88993-5c80-4846-a804-d17c9acec71e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:44.081502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eef88993-5c80-4846-a804-d17c9acec71e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:44.081940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eef88993-5c80-4846-a804-d17c9acec71e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:44.215567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eef88993-5c80-4846-a804-d17c9acec71e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:44.222889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eef88993-5c80-4846-a804-d17c9acec71e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.153624 Jun 20 06:16:44.223448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 247/508] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:44 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:44.946753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7cc2ca83-b913-4af1-b41d-0d83ec923560 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:44.947359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7cc2ca83-b913-4af1-b41d-0d83ec923560 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:44.954545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cc2ca83-b913-4af1-b41d-0d83ec923560 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:44.954993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cc2ca83-b913-4af1-b41d-0d83ec923560 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:44.955753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cc2ca83-b913-4af1-b41d-0d83ec923560 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:44.956338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cc2ca83-b913-4af1-b41d-0d83ec923560 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:45.087729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7cc2ca83-b913-4af1-b41d-0d83ec923560 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:45.096319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7cc2ca83-b913-4af1-b41d-0d83ec923560 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.153775 Jun 20 06:16:45.096910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 262/509] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:44 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:45.240532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6e2be313-88df-483b-8e44-5bba22d4c08b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:45.241057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6e2be313-88df-483b-8e44-5bba22d4c08b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:45.248154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e2be313-88df-483b-8e44-5bba22d4c08b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:45.248589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e2be313-88df-483b-8e44-5bba22d4c08b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:45.249337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e2be313-88df-483b-8e44-5bba22d4c08b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:45.249795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e2be313-88df-483b-8e44-5bba22d4c08b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:45.381154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6e2be313-88df-483b-8e44-5bba22d4c08b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:45.389096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6e2be313-88df-483b-8e44-5bba22d4c08b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.152364 Jun 20 06:16:45.389712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 248/510] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:45 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:46.113940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2d848708-77c6-43e8-bafd-5a6409561145 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:46.114555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2d848708-77c6-43e8-bafd-5a6409561145 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:46.121584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d848708-77c6-43e8-bafd-5a6409561145 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:46.122085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d848708-77c6-43e8-bafd-5a6409561145 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:46.122999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d848708-77c6-43e8-bafd-5a6409561145 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:46.123443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d848708-77c6-43e8-bafd-5a6409561145 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:46.249894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2d848708-77c6-43e8-bafd-5a6409561145 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:46.258040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2d848708-77c6-43e8-bafd-5a6409561145 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.147897 Jun 20 06:16:46.258601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 263/511] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:46 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:46.407760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2436ba54-069d-4f88-a6ed-31afa8c5df62 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:46.408371 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2436ba54-069d-4f88-a6ed-31afa8c5df62 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:46.415277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2436ba54-069d-4f88-a6ed-31afa8c5df62 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:46.415727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2436ba54-069d-4f88-a6ed-31afa8c5df62 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:46.416486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2436ba54-069d-4f88-a6ed-31afa8c5df62 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:46.418057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2436ba54-069d-4f88-a6ed-31afa8c5df62 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:46.553134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2436ba54-069d-4f88-a6ed-31afa8c5df62 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:46.560655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2436ba54-069d-4f88-a6ed-31afa8c5df62 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.156767 Jun 20 06:16:46.561212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 249/512] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:46 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:47.276872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8c58d462-04da-4143-b2ce-ea99ad269580 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:47.277623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8c58d462-04da-4143-b2ce-ea99ad269580 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:47.284172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c58d462-04da-4143-b2ce-ea99ad269580 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:47.284725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c58d462-04da-4143-b2ce-ea99ad269580 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:47.285606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c58d462-04da-4143-b2ce-ea99ad269580 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:47.286047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c58d462-04da-4143-b2ce-ea99ad269580 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:47.421593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8c58d462-04da-4143-b2ce-ea99ad269580 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:47.429486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8c58d462-04da-4143-b2ce-ea99ad269580 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.157403 Jun 20 06:16:47.430041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 264/513] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:47 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:47.579117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b4a88d84-eb81-4111-9e39-0721cabdf588 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:47.579768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b4a88d84-eb81-4111-9e39-0721cabdf588 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:47.586335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4a88d84-eb81-4111-9e39-0721cabdf588 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:47.586792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4a88d84-eb81-4111-9e39-0721cabdf588 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:47.587557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4a88d84-eb81-4111-9e39-0721cabdf588 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:47.587999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4a88d84-eb81-4111-9e39-0721cabdf588 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:47.714452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b4a88d84-eb81-4111-9e39-0721cabdf588 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:47.722036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b4a88d84-eb81-4111-9e39-0721cabdf588 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.146828 Jun 20 06:16:47.722597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 250/514] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:47 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:48.446905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7c2be22c-d98e-4b54-b070-0b50749694df tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:48.447517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7c2be22c-d98e-4b54-b070-0b50749694df tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:48.455081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c2be22c-d98e-4b54-b070-0b50749694df tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:48.455524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c2be22c-d98e-4b54-b070-0b50749694df tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:48.456277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c2be22c-d98e-4b54-b070-0b50749694df tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:48.456705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c2be22c-d98e-4b54-b070-0b50749694df tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:48.586570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7c2be22c-d98e-4b54-b070-0b50749694df tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:48.594773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7c2be22c-d98e-4b54-b070-0b50749694df tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1737 microversion: 2.1 time: 0.151756 Jun 20 06:16:48.595332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 265/515] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:48 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:48.738854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-93e9c09f-5f5b-44d9-ac88-4599a17a7c75 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:48.739454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-93e9c09f-5f5b-44d9-ac88-4599a17a7c75 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:48.746444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93e9c09f-5f5b-44d9-ac88-4599a17a7c75 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:48.746887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93e9c09f-5f5b-44d9-ac88-4599a17a7c75 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:48.747640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93e9c09f-5f5b-44d9-ac88-4599a17a7c75 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:48.748068 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93e9c09f-5f5b-44d9-ac88-4599a17a7c75 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:48.877445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93e9c09f-5f5b-44d9-ac88-4599a17a7c75 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:48.884772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-93e9c09f-5f5b-44d9-ac88-4599a17a7c75 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.149750 Jun 20 06:16:48.885401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 251/516] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:48 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:49.611059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-21c41a81-d70f-44f0-b0fe-8059c798f2ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:49.611594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-21c41a81-d70f-44f0-b0fe-8059c798f2ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:49.618191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21c41a81-d70f-44f0-b0fe-8059c798f2ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.618662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21c41a81-d70f-44f0-b0fe-8059c798f2ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.619429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21c41a81-d70f-44f0-b0fe-8059c798f2ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.619885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21c41a81-d70f-44f0-b0fe-8059c798f2ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.748065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-21c41a81-d70f-44f0-b0fe-8059c798f2ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:49.755883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-21c41a81-d70f-44f0-b0fe-8059c798f2ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1717 microversion: 2.1 time: 0.148818 Jun 20 06:16:49.756448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 266/517] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:49 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1717 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:49.811476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:49.811992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:49.818355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.818799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.819553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.819982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.902772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d764962b-17ad-48fa-9545-c79826a1f3be tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:49.903378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d764962b-17ad-48fa-9545-c79826a1f3be tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:49.909151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d764962b-17ad-48fa-9545-c79826a1f3be tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.909638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d764962b-17ad-48fa-9545-c79826a1f3be tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.910382 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d764962b-17ad-48fa-9545-c79826a1f3be tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.910808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d764962b-17ad-48fa-9545-c79826a1f3be tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.944516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] HTTP exception thrown: Cannot 'detach_volume' instance c03d50ed-386e-42ee-af59-9a0231218aa2 while it is in vm_state rescued Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Request method failure captured: Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments/545dfaba-e787-4cad-a5e9-feab7b18fe13 HTTP/1.1 Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA-DER0TG_EM_kUuulCfSmaf9yvnYbEs_HSUaTrJaHJEUGAeVmc3ObCznlmOxH_83TrveBUV0DgjahoYMfkSeQpz3PDbaMeXgNR0mG3qwNqVtYM9gBT9zPehd8pj9OgXcyTcHyYvPalcO7ldwHo-KFRZP22X4GqW06N6olXwdZB2rwE Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:16:49.946135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}] Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: f49340b89c2a43b288572263ddac7be8 Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:16:49.947687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Cannot 'detach_volume' instance c03d50ed-386e-42ee-af59-9a0231218aa2 while it is in vm_state rescued Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'server_id': 'c03d50ed-386e-42ee-af59-9a0231218aa2', 'id': '545dfaba-e787-4cad-a5e9-feab7b18fe13'} Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c03d50ed-386e-42ee-af59-9a0231218aa2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:16:49.949216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c03d50ed-386e-42ee-af59-9a0231218aa2 while it is in vm_state rescued Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c03d50ed-386e-42ee-af59-9a0231218aa2 while it is in vm_state rescued Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:16:49.951009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Returning 409 to user: Cannot 'detach_volume' instance c03d50ed-386e-42ee-af59-9a0231218aa2 while it is in vm_state rescued {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:16:49.952227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-04eb96a4-234e-4f44-89b7-9deeb1e0530c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments/545dfaba-e787-4cad-a5e9-feab7b18fe13" status: 409 len: 152 microversion: 2.1 time: 0.140651 Jun 20 06:16:49.952227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 252/518] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:16:49 2022] DELETE /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments/545dfaba-e787-4cad-a5e9-feab7b18fe13 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 06:16:49.960376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-891601d3-4857-42c3-9a66-6b2045093a5e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:49.961134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-891601d3-4857-42c3-9a66-6b2045093a5e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:49.967377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-891601d3-4857-42c3-9a66-6b2045093a5e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.967897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-891601d3-4857-42c3-9a66-6b2045093a5e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.968729 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-891601d3-4857-42c3-9a66-6b2045093a5e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.969172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-891601d3-4857-42c3-9a66-6b2045093a5e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:50.008648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:50.038199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-891601d3-4857-42c3-9a66-6b2045093a5e tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "POST /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/action" status: 202 len: 0 microversion: 2.1 time: 0.084588 Jun 20 06:16:50.042053 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 253/519] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:16:49 2022] POST /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:16:50.048520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-538a91e5-03d5-4ab1-bffd-f97905931ec8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:50.049166 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-538a91e5-03d5-4ab1-bffd-f97905931ec8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:50.051165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d764962b-17ad-48fa-9545-c79826a1f3be tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:50.055569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-538a91e5-03d5-4ab1-bffd-f97905931ec8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:50.056017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-538a91e5-03d5-4ab1-bffd-f97905931ec8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:50.056868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-538a91e5-03d5-4ab1-bffd-f97905931ec8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:50.057867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-538a91e5-03d5-4ab1-bffd-f97905931ec8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:50.059735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:50.066053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d764962b-17ad-48fa-9545-c79826a1f3be tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.167443 Jun 20 06:16:50.066610 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 267/520] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:49 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:50.193440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-538a91e5-03d5-4ab1-bffd-f97905931ec8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:50.202534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-538a91e5-03d5-4ab1-bffd-f97905931ec8 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1725 microversion: 2.1 time: 0.159021 Jun 20 06:16:50.203104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 254/521] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:50 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:51.083866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-025464be-3f58-4f35-8bc5-2c510c6bab7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:51.084475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-025464be-3f58-4f35-8bc5-2c510c6bab7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:51.092589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-025464be-3f58-4f35-8bc5-2c510c6bab7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:51.093035 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-025464be-3f58-4f35-8bc5-2c510c6bab7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:51.093828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-025464be-3f58-4f35-8bc5-2c510c6bab7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:51.094261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-025464be-3f58-4f35-8bc5-2c510c6bab7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:51.219422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-405851ad-c1c6-45a8-a238-068780fbcf6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:51.220030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-405851ad-c1c6-45a8-a238-068780fbcf6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:51.227152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-405851ad-c1c6-45a8-a238-068780fbcf6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:51.227603 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-405851ad-c1c6-45a8-a238-068780fbcf6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:51.228470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-405851ad-c1c6-45a8-a238-068780fbcf6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:51.231728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-405851ad-c1c6-45a8-a238-068780fbcf6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:51.232839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-025464be-3f58-4f35-8bc5-2c510c6bab7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:51.240168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-025464be-3f58-4f35-8bc5-2c510c6bab7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.160475 Jun 20 06:16:51.240726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 268/522] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:51 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:51.360840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-405851ad-c1c6-45a8-a238-068780fbcf6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:51.368623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-405851ad-c1c6-45a8-a238-068780fbcf6d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1725 microversion: 2.1 time: 0.153096 Jun 20 06:16:51.369177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 255/523] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:51 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:52.257992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3aafd91b-eb80-4ebf-a6f5-bb3f4a138f1f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:52.258594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3aafd91b-eb80-4ebf-a6f5-bb3f4a138f1f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:52.265143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3aafd91b-eb80-4ebf-a6f5-bb3f4a138f1f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:52.265614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3aafd91b-eb80-4ebf-a6f5-bb3f4a138f1f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:52.266360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3aafd91b-eb80-4ebf-a6f5-bb3f4a138f1f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:52.266785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3aafd91b-eb80-4ebf-a6f5-bb3f4a138f1f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:52.387144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0b53d9c0-48b1-46ff-8243-1f19e7928aa0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:52.387852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0b53d9c0-48b1-46ff-8243-1f19e7928aa0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:52.394724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b53d9c0-48b1-46ff-8243-1f19e7928aa0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:52.395130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b53d9c0-48b1-46ff-8243-1f19e7928aa0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:52.395894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b53d9c0-48b1-46ff-8243-1f19e7928aa0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:52.396326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b53d9c0-48b1-46ff-8243-1f19e7928aa0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:52.399603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3aafd91b-eb80-4ebf-a6f5-bb3f4a138f1f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:52.408401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3aafd91b-eb80-4ebf-a6f5-bb3f4a138f1f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.154191 Jun 20 06:16:52.408976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 269/524] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:52 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:52.530517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0b53d9c0-48b1-46ff-8243-1f19e7928aa0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:52.538345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0b53d9c0-48b1-46ff-8243-1f19e7928aa0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1725 microversion: 2.1 time: 0.155127 Jun 20 06:16:52.538909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 256/525] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:52 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:53.427219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-530220b3-4ad4-4cc9-b44b-06905d146d36 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:53.427747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-530220b3-4ad4-4cc9-b44b-06905d146d36 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:53.434921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-530220b3-4ad4-4cc9-b44b-06905d146d36 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:53.435368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-530220b3-4ad4-4cc9-b44b-06905d146d36 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:53.436123 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-530220b3-4ad4-4cc9-b44b-06905d146d36 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:53.436558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-530220b3-4ad4-4cc9-b44b-06905d146d36 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:53.555066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33603b01-2c65-44d8-b2ea-65fff7f9fcff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:53.555713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-33603b01-2c65-44d8-b2ea-65fff7f9fcff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:53.563013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33603b01-2c65-44d8-b2ea-65fff7f9fcff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:53.563469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33603b01-2c65-44d8-b2ea-65fff7f9fcff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:53.564248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33603b01-2c65-44d8-b2ea-65fff7f9fcff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:53.564693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33603b01-2c65-44d8-b2ea-65fff7f9fcff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:53.565212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-530220b3-4ad4-4cc9-b44b-06905d146d36 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:53.572685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-530220b3-4ad4-4cc9-b44b-06905d146d36 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.149296 Jun 20 06:16:53.573292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 270/526] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:53 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:53.702071 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-33603b01-2c65-44d8-b2ea-65fff7f9fcff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:53.710705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-33603b01-2c65-44d8-b2ea-65fff7f9fcff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1725 microversion: 2.1 time: 0.159461 Jun 20 06:16:53.711284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 257/527] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:53 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:54.589715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d40b3dc-36a4-4c3f-9a65-26157ea47e82 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:54.590256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6d40b3dc-36a4-4c3f-9a65-26157ea47e82 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:54.596669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d40b3dc-36a4-4c3f-9a65-26157ea47e82 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.597110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d40b3dc-36a4-4c3f-9a65-26157ea47e82 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.597895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d40b3dc-36a4-4c3f-9a65-26157ea47e82 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.598332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d40b3dc-36a4-4c3f-9a65-26157ea47e82 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.726732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6d40b3dc-36a4-4c3f-9a65-26157ea47e82 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:54.727908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8bc59404-98b5-4473-96f5-947ab612d4a1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:54.728512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8bc59404-98b5-4473-96f5-947ab612d4a1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:54.734708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6d40b3dc-36a4-4c3f-9a65-26157ea47e82 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.148975 Jun 20 06:16:54.735267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 271/528] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:54 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:54.735922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8bc59404-98b5-4473-96f5-947ab612d4a1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.736368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8bc59404-98b5-4473-96f5-947ab612d4a1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.737126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8bc59404-98b5-4473-96f5-947ab612d4a1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.737582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8bc59404-98b5-4473-96f5-947ab612d4a1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.870462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8bc59404-98b5-4473-96f5-947ab612d4a1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:54.878354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8bc59404-98b5-4473-96f5-947ab612d4a1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1731 microversion: 2.1 time: 0.154225 Jun 20 06:16:54.878907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 258/529] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:54 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:54.894938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b13c6eae-6484-4d90-8c7a-b6eac9c893cb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:54.895429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b13c6eae-6484-4d90-8c7a-b6eac9c893cb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:54.901962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b13c6eae-6484-4d90-8c7a-b6eac9c893cb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.902414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b13c6eae-6484-4d90-8c7a-b6eac9c893cb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.903179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b13c6eae-6484-4d90-8c7a-b6eac9c893cb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.903617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b13c6eae-6484-4d90-8c7a-b6eac9c893cb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.977995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b13c6eae-6484-4d90-8c7a-b6eac9c893cb tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087164 Jun 20 06:16:54.978578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 272/530] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jun 20 06:16:54 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:55.751638 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4f479c35-1f9f-4c1c-80c0-8de91025f038 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:55.752457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4f479c35-1f9f-4c1c-80c0-8de91025f038 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:55.758802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f479c35-1f9f-4c1c-80c0-8de91025f038 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:55.759246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f479c35-1f9f-4c1c-80c0-8de91025f038 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:55.760006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f479c35-1f9f-4c1c-80c0-8de91025f038 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:55.761094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f479c35-1f9f-4c1c-80c0-8de91025f038 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:55.970550 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4f479c35-1f9f-4c1c-80c0-8de91025f038 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:55.977911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4f479c35-1f9f-4c1c-80c0-8de91025f038 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.230066 Jun 20 06:16:55.978501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 259/531] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:55 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:56.208460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-7c67be26-dc17-4376-b6b2-4e5ccd5b5140 req-a592c25f-93be-4d85-94d1-db2064dd1722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03d50ed-386e-42ee-af59-9a0231218aa2", "tag": "dd50376a-5980-4629-b056-2a634e6fb53b"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:56.216857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-7c67be26-dc17-4376-b6b2-4e5ccd5b5140 req-a592c25f-93be-4d85-94d1-db2064dd1722 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:56.217398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-7c67be26-dc17-4376-b6b2-4e5ccd5b5140 req-a592c25f-93be-4d85-94d1-db2064dd1722 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:56.228605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-7c67be26-dc17-4376-b6b2-4e5ccd5b5140 req-a592c25f-93be-4d85-94d1-db2064dd1722 service nova] Creating event network-changed:dd50376a-5980-4629-b056-2a634e6fb53b for instance c03d50ed-386e-42ee-af59-9a0231218aa2 on hv-cinder-80473 Jun 20 06:16:56.234171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-7c67be26-dc17-4376-b6b2-4e5ccd5b5140 req-a592c25f-93be-4d85-94d1-db2064dd1722 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087191 Jun 20 06:16:56.234750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 273/532] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:56.995479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-77c54e46-3008-4a97-bb67-bdd5850a97b7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:56.996100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-77c54e46-3008-4a97-bb67-bdd5850a97b7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:56.998642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=43 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:57.004399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77c54e46-3008-4a97-bb67-bdd5850a97b7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:57.004846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77c54e46-3008-4a97-bb67-bdd5850a97b7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:57.005640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77c54e46-3008-4a97-bb67-bdd5850a97b7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:57.006074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77c54e46-3008-4a97-bb67-bdd5850a97b7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:57.134304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-77c54e46-3008-4a97-bb67-bdd5850a97b7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:57.142504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-77c54e46-3008-4a97-bb67-bdd5850a97b7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1675 microversion: 2.1 time: 0.151503 Jun 20 06:16:57.143058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 260/533] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:56 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:58.161741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1a1c5d70-99f4-42e2-badb-9ec4a507b9f0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:58.162440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1a1c5d70-99f4-42e2-badb-9ec4a507b9f0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:58.169200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a1c5d70-99f4-42e2-badb-9ec4a507b9f0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.169683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a1c5d70-99f4-42e2-badb-9ec4a507b9f0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.170441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a1c5d70-99f4-42e2-badb-9ec4a507b9f0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.170875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a1c5d70-99f4-42e2-badb-9ec4a507b9f0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.248047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-85c64fda-1e8c-4b08-854d-aa5c84188cfd req-b9e4570b-840d-492f-8563-42bb5a2bc985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03d50ed-386e-42ee-af59-9a0231218aa2", "tag": "dd50376a-5980-4629-b056-2a634e6fb53b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:58.257041 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-85c64fda-1e8c-4b08-854d-aa5c84188cfd req-b9e4570b-840d-492f-8563-42bb5a2bc985 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.257516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-85c64fda-1e8c-4b08-854d-aa5c84188cfd req-b9e4570b-840d-492f-8563-42bb5a2bc985 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.268508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-85c64fda-1e8c-4b08-854d-aa5c84188cfd req-b9e4570b-840d-492f-8563-42bb5a2bc985 service nova] Creating event network-changed:dd50376a-5980-4629-b056-2a634e6fb53b for instance c03d50ed-386e-42ee-af59-9a0231218aa2 on hv-cinder-80473 Jun 20 06:16:58.273851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-85c64fda-1e8c-4b08-854d-aa5c84188cfd req-b9e4570b-840d-492f-8563-42bb5a2bc985 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029404 Jun 20 06:16:58.274447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 261/534] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:16:58.305512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1a1c5d70-99f4-42e2-badb-9ec4a507b9f0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:58.313893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1a1c5d70-99f4-42e2-badb-9ec4a507b9f0 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1652 microversion: 2.1 time: 0.156760 Jun 20 06:16:58.317200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 274/535] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:58 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1652 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:58.331483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-26e2cca4-66fa-4eda-bfcc-35d954d70940 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:58.337827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26e2cca4-66fa-4eda-bfcc-35d954d70940 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.338813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26e2cca4-66fa-4eda-bfcc-35d954d70940 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.361679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-26e2cca4-66fa-4eda-bfcc-35d954d70940 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Going to try to start instance {{(pid=117727) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 06:16:58.404011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-26e2cca4-66fa-4eda-bfcc-35d954d70940 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/action" status: 202 len: 0 microversion: 2.1 time: 0.076621 Jun 20 06:16:58.404529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 262/536] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:16:58 2022] POST /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:16:58.412760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-84132f5d-cba2-424b-a186-d02fbd8d83f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:58.413704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-84132f5d-cba2-424b-a186-d02fbd8d83f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:58.421439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84132f5d-cba2-424b-a186-d02fbd8d83f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.422456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84132f5d-cba2-424b-a186-d02fbd8d83f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.423329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84132f5d-cba2-424b-a186-d02fbd8d83f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.423818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84132f5d-cba2-424b-a186-d02fbd8d83f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.606658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-84132f5d-cba2-424b-a186-d02fbd8d83f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:58.614422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-84132f5d-cba2-424b-a186-d02fbd8d83f2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1661 microversion: 2.1 time: 0.205928 Jun 20 06:16:58.615355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 275/537] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:58 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1661 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:59.632550 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-49c36bf8-363c-47b6-97a0-b3ba0c94c767 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:59.633274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-49c36bf8-363c-47b6-97a0-b3ba0c94c767 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:59.639840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49c36bf8-363c-47b6-97a0-b3ba0c94c767 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:59.640282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49c36bf8-363c-47b6-97a0-b3ba0c94c767 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:59.641034 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49c36bf8-363c-47b6-97a0-b3ba0c94c767 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:59.641495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49c36bf8-363c-47b6-97a0-b3ba0c94c767 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:59.769161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49c36bf8-363c-47b6-97a0-b3ba0c94c767 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:59.777900 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-49c36bf8-363c-47b6-97a0-b3ba0c94c767 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1661 microversion: 2.1 time: 0.149996 Jun 20 06:16:59.778472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 263/538] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:59 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:00.795808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e8620283-74bd-434c-9af0-58f04aded8db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:00.796407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e8620283-74bd-434c-9af0-58f04aded8db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:00.803024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8620283-74bd-434c-9af0-58f04aded8db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:00.803587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8620283-74bd-434c-9af0-58f04aded8db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:00.804346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8620283-74bd-434c-9af0-58f04aded8db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:00.804780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8620283-74bd-434c-9af0-58f04aded8db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:00.934272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e8620283-74bd-434c-9af0-58f04aded8db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:00.941506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e8620283-74bd-434c-9af0-58f04aded8db tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1665 microversion: 2.1 time: 0.150490 Jun 20 06:17:00.942071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 276/539] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:00 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:20.032270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8af1973-7b16-4da0-a8ed-fd5c1b1b9e6a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:20.032847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8af1973-7b16-4da0-a8ed-fd5c1b1b9e6a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:20.035069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=7 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:20.035787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=62,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:20.042106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8af1973-7b16-4da0-a8ed-fd5c1b1b9e6a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.042552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8af1973-7b16-4da0-a8ed-fd5c1b1b9e6a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.043316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8af1973-7b16-4da0-a8ed-fd5c1b1b9e6a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.043749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8af1973-7b16-4da0-a8ed-fd5c1b1b9e6a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.067870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8af1973-7b16-4da0-a8ed-fd5c1b1b9e6a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1/ips" status: 200 len: 150 microversion: 2.1 time: 0.039735 Jun 20 06:17:20.068428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 264/540] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:17:20 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:20.080174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d828c039-6fb0-48ad-b274-0b625d720c77"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:20.081262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:20.083448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=44 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:20.084092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=48 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:20.089740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.090230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.090993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.091530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.169046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Invalid volume: volume d828c039-6fb0-48ad-b274-0b625d720c77 is already attached to instances: aa304480-6854-41f6-8fdc-6cf9581ca96f Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: POST /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1/os-volume_attachments HTTP/1.1 Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 74 Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:17:20.170819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {"volumeAttachment": {"volumeId": "d828c039-6fb0-48ad-b274-0b625d720c77"}} Jun 20 06:17:20.172368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Invalid volume: volume d828c039-6fb0-48ad-b274-0b625d720c77 is already attached to instances: aa304480-6854-41f6-8fdc-6cf9581ca96f Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'server_id': '124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1', 'body': {'volumeAttachment': {'volumeId': 'd828c039-6fb0-48ad-b274-0b625d720c77'}}} Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d828c039-6fb0-48ad-b274-0b625d720c77 is already attached to instances: aa304480-6854-41f6-8fdc-6cf9581ca96f Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:20.173203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d828c039-6fb0-48ad-b274-0b625d720c77 is already attached to instances: aa304480-6854-41f6-8fdc-6cf9581ca96f Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:20.174420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:20.175633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:20.175633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:17:20.175633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:17:20.175633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d828c039-6fb0-48ad-b274-0b625d720c77 is already attached to instances: aa304480-6854-41f6-8fdc-6cf9581ca96f Jun 20 06:17:20.175633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:20.175633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 400 to user: Invalid volume: volume d828c039-6fb0-48ad-b274-0b625d720c77 is already attached to instances: aa304480-6854-41f6-8fdc-6cf9581ca96f {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:17:20.175633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-38d9b5ae-caf4-4861-a0a3-52db004747c1 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096206 Jun 20 06:17:20.175633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 277/541] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:17:20 2022] POST /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:17:20.180818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-efc4cfdd-4bf0-4da6-b072-4931901f356c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:20.181313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-efc4cfdd-4bf0-4da6-b072-4931901f356c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:20.187994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efc4cfdd-4bf0-4da6-b072-4931901f356c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.188446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efc4cfdd-4bf0-4da6-b072-4931901f356c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.189205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efc4cfdd-4bf0-4da6-b072-4931901f356c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.189667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efc4cfdd-4bf0-4da6-b072-4931901f356c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.214486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-efc4cfdd-4bf0-4da6-b072-4931901f356c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:17:20.288572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-efc4cfdd-4bf0-4da6-b072-4931901f356c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 204 len: 0 microversion: 2.1 time: 0.111208 Jun 20 06:17:20.289303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 265/542] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:17:20 2022] DELETE /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:17:20.300331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3e09d698-ae85-4546-8fa5-1e6ad8fea5a9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:20.300958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3e09d698-ae85-4546-8fa5-1e6ad8fea5a9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:20.308453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e09d698-ae85-4546-8fa5-1e6ad8fea5a9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.308902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e09d698-ae85-4546-8fa5-1e6ad8fea5a9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.309686 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e09d698-ae85-4546-8fa5-1e6ad8fea5a9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:20.310114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e09d698-ae85-4546-8fa5-1e6ad8fea5a9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:20.439045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3e09d698-ae85-4546-8fa5-1e6ad8fea5a9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:20.446407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3e09d698-ae85-4546-8fa5-1e6ad8fea5a9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1683 microversion: 2.1 time: 0.152004 Jun 20 06:17:20.447642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 278/543] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:20 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:21.468525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cab576f8-8e67-4071-b721-d7466f9f8194 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:21.469150 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cab576f8-8e67-4071-b721-d7466f9f8194 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:21.475639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cab576f8-8e67-4071-b721-d7466f9f8194 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:21.476101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cab576f8-8e67-4071-b721-d7466f9f8194 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:21.476869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cab576f8-8e67-4071-b721-d7466f9f8194 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:21.477308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cab576f8-8e67-4071-b721-d7466f9f8194 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:21.608495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cab576f8-8e67-4071-b721-d7466f9f8194 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:21.616009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cab576f8-8e67-4071-b721-d7466f9f8194 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1683 microversion: 2.1 time: 0.151810 Jun 20 06:17:21.616567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 266/544] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:21 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:22.632894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-be644a6d-caa2-4570-ad3d-e3f0d21aef33 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:22.633579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-be644a6d-caa2-4570-ad3d-e3f0d21aef33 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:22.640491 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be644a6d-caa2-4570-ad3d-e3f0d21aef33 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:22.640939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be644a6d-caa2-4570-ad3d-e3f0d21aef33 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:22.641740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be644a6d-caa2-4570-ad3d-e3f0d21aef33 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:22.642174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be644a6d-caa2-4570-ad3d-e3f0d21aef33 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:22.730856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-be644a6d-caa2-4570-ad3d-e3f0d21aef33 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:22.738285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-be644a6d-caa2-4570-ad3d-e3f0d21aef33 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 200 len: 1615 microversion: 2.1 time: 0.109021 Jun 20 06:17:22.738850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 279/545] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:22 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 1615 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:22.999087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-34afe631-458d-4745-bbe9-0216d8f5ab7a req-f09ec0df-dc00-419f-b408-7f0d412df3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1", "name": "network-vif-deleted", "tag": "3773a194-19ba-4ab8-aba8-914fd70f064c"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:23.010514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-34afe631-458d-4745-bbe9-0216d8f5ab7a req-f09ec0df-dc00-419f-b408-7f0d412df3fc service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:23.011220 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-34afe631-458d-4745-bbe9-0216d8f5ab7a req-f09ec0df-dc00-419f-b408-7f0d412df3fc service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:23.023163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-34afe631-458d-4745-bbe9-0216d8f5ab7a req-f09ec0df-dc00-419f-b408-7f0d412df3fc service nova] Creating event network-vif-deleted:3773a194-19ba-4ab8-aba8-914fd70f064c for instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 on hv-cinder-80473 Jun 20 06:17:23.029292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-34afe631-458d-4745-bbe9-0216d8f5ab7a req-f09ec0df-dc00-419f-b408-7f0d412df3fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 Jun 20 06:17:23.030154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 267/546] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:23.758206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:23.758842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:23.765641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:23.766084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:23.766840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:23.767266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:23.781643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 HTTP/1.1 Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:17:23.783334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:17:23.784637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1'} Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:17:23.785495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:17:23.786816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:23.787942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:17:23.787942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0b8d2b1e-c189-49e5-bf0c-86c42e01af04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 404 len: 111 microversion: 2.1 time: 0.031258 Jun 20 06:17:23.787942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 280/547] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:23 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:17:23.796633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e2ed0f3-acd1-4ec1-9289-f7769aaae759 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '.version_select at 0x7f7a7a7409d0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:23.799877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5e2ed0f3-acd1-4ec1-9289-f7769aaae759 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [93fe0515-a501-4bcc-82bf-d29ed45b0a85] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 06:17:24.808838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [None req-5e2ed0f3-acd1-4ec1-9289-f7769aaae759 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [93fe0515-a501-4bcc-82bf-d29ed45b0a85] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37766. Jun 20 06:17:24.829234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e2ed0f3-acd1-4ec1-9289-f7769aaae759 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346049991" status: 202 len: 0 microversion: 2.1 time: 1.038180 Jun 20 06:17:24.830123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 268/548] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Jun 20 06:17:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346049991 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:17:25.497774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e04e504a-1b0d-478a-a2d9-ef45875cd05e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:25.498250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e04e504a-1b0d-478a-a2d9-ef45875cd05e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:25.504564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e04e504a-1b0d-478a-a2d9-ef45875cd05e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:25.505003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e04e504a-1b0d-478a-a2d9-ef45875cd05e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:25.505779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e04e504a-1b0d-478a-a2d9-ef45875cd05e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:25.506204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e04e504a-1b0d-478a-a2d9-ef45875cd05e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:25.584540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-e04e504a-1b0d-478a-a2d9-ef45875cd05e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lazy-loading 'services' on Instance uuid aa304480-6854-41f6-8fdc-6cf9581ca96f {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:17:25.659207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e04e504a-1b0d-478a-a2d9-ef45875cd05e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-volume_attachments/d828c039-6fb0-48ad-b274-0b625d720c77" status: 202 len: 0 microversion: 2.1 time: 0.165681 Jun 20 06:17:25.659843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 281/549] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:17:25 2022] DELETE /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-volume_attachments/d828c039-6fb0-48ad-b274-0b625d720c77 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:17:25.669215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-13baab9b-09da-4349-b972-0df1cd1d4ae2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:25.670271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-13baab9b-09da-4349-b972-0df1cd1d4ae2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:25.676935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13baab9b-09da-4349-b972-0df1cd1d4ae2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:25.677410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13baab9b-09da-4349-b972-0df1cd1d4ae2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:25.678249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13baab9b-09da-4349-b972-0df1cd1d4ae2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:25.678684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13baab9b-09da-4349-b972-0df1cd1d4ae2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:25.709545 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-13baab9b-09da-4349-b972-0df1cd1d4ae2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Jun 20 06:17:25.710128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 269/550] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:17:25 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:26.723216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-51a98dde-abf5-46ea-a61c-5be35a3e0d6c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:26.724317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-51a98dde-abf5-46ea-a61c-5be35a3e0d6c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:26.730681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51a98dde-abf5-46ea-a61c-5be35a3e0d6c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:26.731118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51a98dde-abf5-46ea-a61c-5be35a3e0d6c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:26.731885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51a98dde-abf5-46ea-a61c-5be35a3e0d6c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:26.732319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51a98dde-abf5-46ea-a61c-5be35a3e0d6c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:26.762745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-51a98dde-abf5-46ea-a61c-5be35a3e0d6c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044592 Jun 20 06:17:26.763292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 282/551] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:17:26 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:17:26.821538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f11046d5-d310-42ce-a1b9-bf1968e93c94 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:26.822163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f11046d5-d310-42ce-a1b9-bf1968e93c94 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:26.829827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11046d5-d310-42ce-a1b9-bf1968e93c94 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:26.830270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11046d5-d310-42ce-a1b9-bf1968e93c94 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:26.831028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11046d5-d310-42ce-a1b9-bf1968e93c94 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:26.831460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11046d5-d310-42ce-a1b9-bf1968e93c94 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:26.855945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f11046d5-d310-42ce-a1b9-bf1968e93c94 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:17:26.929514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f11046d5-d310-42ce-a1b9-bf1968e93c94 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 204 len: 0 microversion: 2.1 time: 0.111293 Jun 20 06:17:26.930770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 270/552] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:17:26 2022] DELETE /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:17:26.941139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e339add3-625e-441b-bd53-2e1bd4fd0d73 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:26.942040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e339add3-625e-441b-bd53-2e1bd4fd0d73 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:26.948632 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e339add3-625e-441b-bd53-2e1bd4fd0d73 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:26.949077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e339add3-625e-441b-bd53-2e1bd4fd0d73 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:26.949867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e339add3-625e-441b-bd53-2e1bd4fd0d73 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:26.950299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e339add3-625e-441b-bd53-2e1bd4fd0d73 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:27.082811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e339add3-625e-441b-bd53-2e1bd4fd0d73 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:27.090281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e339add3-625e-441b-bd53-2e1bd4fd0d73 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1681 microversion: 2.1 time: 0.154185 Jun 20 06:17:27.090850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 283/553] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:26 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:28.108311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-64c60551-cb28-43ee-b33b-2d98ec2d0414 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:28.109012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-64c60551-cb28-43ee-b33b-2d98ec2d0414 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:28.115338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64c60551-cb28-43ee-b33b-2d98ec2d0414 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:28.115782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64c60551-cb28-43ee-b33b-2d98ec2d0414 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:28.116546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64c60551-cb28-43ee-b33b-2d98ec2d0414 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:28.116974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64c60551-cb28-43ee-b33b-2d98ec2d0414 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:28.247652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-64c60551-cb28-43ee-b33b-2d98ec2d0414 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:28.255419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-64c60551-cb28-43ee-b33b-2d98ec2d0414 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1681 microversion: 2.1 time: 0.151650 Jun 20 06:17:28.255994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 271/554] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:28 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:29.274206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9cdb484a-cb17-4742-bde7-d8462a7080fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:29.274811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9cdb484a-cb17-4742-bde7-d8462a7080fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:29.281538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9cdb484a-cb17-4742-bde7-d8462a7080fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:29.281983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9cdb484a-cb17-4742-bde7-d8462a7080fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:29.282753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9cdb484a-cb17-4742-bde7-d8462a7080fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:29.283217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9cdb484a-cb17-4742-bde7-d8462a7080fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:29.510312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9cdb484a-cb17-4742-bde7-d8462a7080fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:29.517881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9cdb484a-cb17-4742-bde7-d8462a7080fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 200 len: 1681 microversion: 2.1 time: 0.247507 Jun 20 06:17:29.518455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 284/555] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:29 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:29.928427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-9f61470d-9fad-4ac7-a531-9d4f2a2e09ea req-1c426b10-c79c-461f-b99f-ab427ed09e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa304480-6854-41f6-8fdc-6cf9581ca96f", "name": "network-vif-deleted", "tag": "3e696beb-43da-47a0-bfcd-4048ff26344f"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:29.938606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-9f61470d-9fad-4ac7-a531-9d4f2a2e09ea req-1c426b10-c79c-461f-b99f-ab427ed09e6c service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:29.939070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-9f61470d-9fad-4ac7-a531-9d4f2a2e09ea req-1c426b10-c79c-461f-b99f-ab427ed09e6c service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:29.950865 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-9f61470d-9fad-4ac7-a531-9d4f2a2e09ea req-1c426b10-c79c-461f-b99f-ab427ed09e6c service nova] Creating event network-vif-deleted:3e696beb-43da-47a0-bfcd-4048ff26344f for instance aa304480-6854-41f6-8fdc-6cf9581ca96f on hv-cinder-80473 Jun 20 06:17:29.956010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-9f61470d-9fad-4ac7-a531-9d4f2a2e09ea req-1c426b10-c79c-461f-b99f-ab427ed09e6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031143 Jun 20 06:17:29.956787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 272/556] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:30.535789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:30.536513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:30.543220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:30.543734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:30.544498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:30.544925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:30.558594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f HTTP/1.1 Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:17:30.560142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:17:30.561849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'aa304480-6854-41f6-8fdc-6cf9581ca96f'} Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:17:30.562673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:17:30.563934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:30.565033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:17:30.565033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a57e2d44-bc7e-4d3e-9577-fdd3418f2514 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 404 len: 111 microversion: 2.1 time: 0.029586 Jun 20 06:17:30.565033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 285/557] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:30 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:17:30.571491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2ebf66e3-4d8f-488c-ac77-12f6108a8c1a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '.version_select at 0x7f7a7a7478b0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:30.589978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2ebf66e3-4d8f-488c-ac77-12f6108a8c1a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-674793659" status: 202 len: 0 microversion: 2.1 time: 0.022803 Jun 20 06:17:30.590553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 273/558] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jun 20 06:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-674793659 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:17:31.245395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9c302e1c-9ee7-4565-9387-c42280d646a3 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: .version_select at 0x7f7a7a77c790>, body: {"keypair": {"name": "tempest-keypair-702014343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTxvEqpjU/lvE8iNjrZMscgd75pbNZzMVyp2rU5OtlSUrZbTBJiwrr6ICyjJ10QxZrylItQKOBGCeuXjSDk+XnMv/LdP8OG/DQLQjpOr76AQf0oRcOUmZahehcrxlbZoQ=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:31.259354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-9c302e1c-9ee7-4565-9387-c42280d646a3 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for project fde00bac11024d898d6d87b8d2abc29e. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:17:31.263946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-9c302e1c-9ee7-4565-9387-c42280d646a3 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for user ee7405c2b1504907ba919e2797e63754 and project fde00bac11024d898d6d87b8d2abc29e. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:17:31.285216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9c302e1c-9ee7-4565-9387-c42280d646a3 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044351 Jun 20 06:17:31.285829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 286/559] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:17:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:32.523580 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1813679632", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9962bf9-afc3-4bca-900b-7a55dc02f894"}], "security_groups": [{"name": "tempest-securitygroup--302792698"}], "key_name": "tempest-keypair-702014343", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:32.628507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] validate_networks() for [('e9962bf9-afc3-4bca-900b-7a55dc02f894', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:17:33.052410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:17:33.052836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:17:33.053341 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:17:33.053788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:17:33.054201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:17:33.063704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:33.064156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:33.064958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:33.065427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:33.081810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for project fde00bac11024d898d6d87b8d2abc29e. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:17:33.085789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for user ee7405c2b1504907ba919e2797e63754 and project fde00bac11024d898d6d87b8d2abc29e. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:17:33.096880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:17:33.099273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:17:33.146319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ec95a720-600c-4b1b-b484-9f61a3ba7503 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.627701 Jun 20 06:17:33.146963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 274/560] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:17:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:17:33.157636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9212a476-b80d-406b-9267-c28ad36a3ef5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:33.158831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9212a476-b80d-406b-9267-c28ad36a3ef5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:33.212005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9212a476-b80d-406b-9267-c28ad36a3ef5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:33.219049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9212a476-b80d-406b-9267-c28ad36a3ef5 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1241 microversion: 2.1 time: 0.065934 Jun 20 06:17:33.219610 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 287/561] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:33 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:34.236331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2e90f956-ec00-4451-8ddf-070c82ee656a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:34.236966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2e90f956-ec00-4451-8ddf-070c82ee656a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:34.291812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2e90f956-ec00-4451-8ddf-070c82ee656a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:34.299016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2e90f956-ec00-4451-8ddf-070c82ee656a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1241 microversion: 2.1 time: 0.066925 Jun 20 06:17:34.299647 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 275/562] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:34 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:35.316522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ef7fee48-88e9-49a8-8bd6-2ba9f3b26df9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:35.317134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ef7fee48-88e9-49a8-8bd6-2ba9f3b26df9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:35.369484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ef7fee48-88e9-49a8-8bd6-2ba9f3b26df9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:35.376980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ef7fee48-88e9-49a8-8bd6-2ba9f3b26df9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1241 microversion: 2.1 time: 0.064188 Jun 20 06:17:35.377575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 288/563] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:35 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:36.395294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3e4a8987-539a-4e77-84ae-3de703616dbb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:36.395895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3e4a8987-539a-4e77-84ae-3de703616dbb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:36.450469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3e4a8987-539a-4e77-84ae-3de703616dbb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:36.456986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3e4a8987-539a-4e77-84ae-3de703616dbb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1241 microversion: 2.1 time: 0.065760 Jun 20 06:17:36.457567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 276/564] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:36 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:37.473507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a7df0dc2-a9fc-4ead-8535-e308cd4449ed tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:37.474053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a7df0dc2-a9fc-4ead-8535-e308cd4449ed tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:37.481837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7df0dc2-a9fc-4ead-8535-e308cd4449ed tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:37.482289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7df0dc2-a9fc-4ead-8535-e308cd4449ed tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:37.483046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7df0dc2-a9fc-4ead-8535-e308cd4449ed tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:37.483478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7df0dc2-a9fc-4ead-8535-e308cd4449ed tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:37.542882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a7df0dc2-a9fc-4ead-8535-e308cd4449ed tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:37.550332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a7df0dc2-a9fc-4ead-8535-e308cd4449ed tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1245 microversion: 2.1 time: 0.080745 Jun 20 06:17:37.550886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 289/565] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:37 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:38.567730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cdd0f542-2150-4133-bd2d-508c1f72479b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:38.568420 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cdd0f542-2150-4133-bd2d-508c1f72479b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:38.576622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdd0f542-2150-4133-bd2d-508c1f72479b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:38.577078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdd0f542-2150-4133-bd2d-508c1f72479b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:38.577878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdd0f542-2150-4133-bd2d-508c1f72479b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:38.578320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdd0f542-2150-4133-bd2d-508c1f72479b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:38.669925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cdd0f542-2150-4133-bd2d-508c1f72479b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:38.677276 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cdd0f542-2150-4133-bd2d-508c1f72479b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1299 microversion: 2.1 time: 0.113391 Jun 20 06:17:38.678064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 277/566] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:38 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:39.692077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-2cf1e5f2-af0a-4c28-9d8b-5365219069d6 req-bf638b7f-97f4-472e-aee2-0adda579a993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f341d742-be1b-4305-96ef-cebe35a09f86", "tag": "19241efd-327c-488f-b71f-e1053dad3a90"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:39.694753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd539d9b-6750-4a4a-85e9-a758fc3c1098 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:39.695938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd539d9b-6750-4a4a-85e9-a758fc3c1098 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:39.703209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd539d9b-6750-4a4a-85e9-a758fc3c1098 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.704029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd539d9b-6750-4a4a-85e9-a758fc3c1098 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.705316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd539d9b-6750-4a4a-85e9-a758fc3c1098 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.705995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd539d9b-6750-4a4a-85e9-a758fc3c1098 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.707039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-2cf1e5f2-af0a-4c28-9d8b-5365219069d6 req-bf638b7f-97f4-472e-aee2-0adda579a993 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.707579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-2cf1e5f2-af0a-4c28-9d8b-5365219069d6 req-bf638b7f-97f4-472e-aee2-0adda579a993 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.727837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-2cf1e5f2-af0a-4c28-9d8b-5365219069d6 req-bf638b7f-97f4-472e-aee2-0adda579a993 service nova] Creating event network-changed:19241efd-327c-488f-b71f-e1053dad3a90 for instance f341d742-be1b-4305-96ef-cebe35a09f86 on hv-cinder-80473 Jun 20 06:17:39.734794 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-2cf1e5f2-af0a-4c28-9d8b-5365219069d6 req-bf638b7f-97f4-472e-aee2-0adda579a993 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046690 Jun 20 06:17:39.737767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 290/567] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:39.936913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd539d9b-6750-4a4a-85e9-a758fc3c1098 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:39.944275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd539d9b-6750-4a4a-85e9-a758fc3c1098 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1366 microversion: 2.1 time: 0.253205 Jun 20 06:17:39.944850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 278/568] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:39 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:40.961906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f2ae5e8e-1bc4-499f-8bd4-6ac0e18f3832 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:40.962597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f2ae5e8e-1bc4-499f-8bd4-6ac0e18f3832 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:40.969229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2ae5e8e-1bc4-499f-8bd4-6ac0e18f3832 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:40.969711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2ae5e8e-1bc4-499f-8bd4-6ac0e18f3832 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:40.970465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2ae5e8e-1bc4-499f-8bd4-6ac0e18f3832 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:40.970893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2ae5e8e-1bc4-499f-8bd4-6ac0e18f3832 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:41.098740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f2ae5e8e-1bc4-499f-8bd4-6ac0e18f3832 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:41.106612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f2ae5e8e-1bc4-499f-8bd4-6ac0e18f3832 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1366 microversion: 2.1 time: 0.149518 Jun 20 06:17:41.107162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 291/569] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:40 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:42.123115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-081a98e0-037c-466f-98bf-f769c3e55eb4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:42.123771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-081a98e0-037c-466f-98bf-f769c3e55eb4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:42.130261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-081a98e0-037c-466f-98bf-f769c3e55eb4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:42.130715 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-081a98e0-037c-466f-98bf-f769c3e55eb4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:42.131480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-081a98e0-037c-466f-98bf-f769c3e55eb4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:42.131923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-081a98e0-037c-466f-98bf-f769c3e55eb4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:42.266601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-081a98e0-037c-466f-98bf-f769c3e55eb4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:42.274476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-081a98e0-037c-466f-98bf-f769c3e55eb4 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1366 microversion: 2.1 time: 0.155314 Jun 20 06:17:42.275127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 279/570] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:42 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:43.292964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-27d7eccb-4ad8-459c-b5e6-46851032446c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:43.293601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-27d7eccb-4ad8-459c-b5e6-46851032446c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:43.302836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27d7eccb-4ad8-459c-b5e6-46851032446c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:43.303288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27d7eccb-4ad8-459c-b5e6-46851032446c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:43.304061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27d7eccb-4ad8-459c-b5e6-46851032446c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:43.304495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27d7eccb-4ad8-459c-b5e6-46851032446c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:43.437062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-27d7eccb-4ad8-459c-b5e6-46851032446c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:43.444358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-27d7eccb-4ad8-459c-b5e6-46851032446c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1366 microversion: 2.1 time: 0.155969 Jun 20 06:17:43.444899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 292/571] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:43 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:44.461889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-841c6990-2c5e-4545-be82-a3a3ff42e15e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:44.462522 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-841c6990-2c5e-4545-be82-a3a3ff42e15e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:44.464588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:44.470405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-841c6990-2c5e-4545-be82-a3a3ff42e15e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:44.470783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-841c6990-2c5e-4545-be82-a3a3ff42e15e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:44.471556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-841c6990-2c5e-4545-be82-a3a3ff42e15e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:44.471990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-841c6990-2c5e-4545-be82-a3a3ff42e15e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:44.578694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-c055e8a9-092d-47ed-92b3-3b5bbae638b1 req-5b4cf957-5734-4e35-9c5c-ffee04d04415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f341d742-be1b-4305-96ef-cebe35a09f86", "name": "network-vif-plugged", "status": "completed", "tag": "19241efd-327c-488f-b71f-e1053dad3a90"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:44.587001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c055e8a9-092d-47ed-92b3-3b5bbae638b1 req-5b4cf957-5734-4e35-9c5c-ffee04d04415 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:44.587771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c055e8a9-092d-47ed-92b3-3b5bbae638b1 req-5b4cf957-5734-4e35-9c5c-ffee04d04415 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:44.601698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-c055e8a9-092d-47ed-92b3-3b5bbae638b1 req-5b4cf957-5734-4e35-9c5c-ffee04d04415 service nova] Creating event network-vif-plugged:19241efd-327c-488f-b71f-e1053dad3a90 for instance f341d742-be1b-4305-96ef-cebe35a09f86 on hv-cinder-80473 Jun 20 06:17:44.607183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-c055e8a9-092d-47ed-92b3-3b5bbae638b1 req-5b4cf957-5734-4e35-9c5c-ffee04d04415 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093919 Jun 20 06:17:44.607845 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 293/572] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:44.616086 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-841c6990-2c5e-4545-be82-a3a3ff42e15e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:44.624133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-841c6990-2c5e-4545-be82-a3a3ff42e15e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1366 microversion: 2.1 time: 0.166391 Jun 20 06:17:44.624685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 280/573] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:44 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:45.638081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=8 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:45.642923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-18404e55-555c-4780-9e6e-f899f321ee79 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:45.643609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-18404e55-555c-4780-9e6e-f899f321ee79 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:45.650274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18404e55-555c-4780-9e6e-f899f321ee79 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:45.650748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18404e55-555c-4780-9e6e-f899f321ee79 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:45.652230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18404e55-555c-4780-9e6e-f899f321ee79 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:45.652667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18404e55-555c-4780-9e6e-f899f321ee79 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:45.779082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-18404e55-555c-4780-9e6e-f899f321ee79 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:45.786433 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-18404e55-555c-4780-9e6e-f899f321ee79 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1366 microversion: 2.1 time: 0.149288 Jun 20 06:17:45.786998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 294/574] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:45 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:46.803346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f28a6b33-c398-4325-bf9c-aeea1a8dd482 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:46.804072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f28a6b33-c398-4325-bf9c-aeea1a8dd482 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:46.806371 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=10 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:46.812851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f28a6b33-c398-4325-bf9c-aeea1a8dd482 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:46.813463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f28a6b33-c398-4325-bf9c-aeea1a8dd482 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:46.814251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f28a6b33-c398-4325-bf9c-aeea1a8dd482 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:46.814696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f28a6b33-c398-4325-bf9c-aeea1a8dd482 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:46.949286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f28a6b33-c398-4325-bf9c-aeea1a8dd482 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:46.956766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f28a6b33-c398-4325-bf9c-aeea1a8dd482 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1556 microversion: 2.1 time: 0.157416 Jun 20 06:17:46.957330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 281/575] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:46 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:46.972787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7c8ee4e0-b4f5-4e25-8cdb-e264bf57fb3b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:46.973305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7c8ee4e0-b4f5-4e25-8cdb-e264bf57fb3b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:46.979704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c8ee4e0-b4f5-4e25-8cdb-e264bf57fb3b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:46.980140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c8ee4e0-b4f5-4e25-8cdb-e264bf57fb3b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:46.980888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c8ee4e0-b4f5-4e25-8cdb-e264bf57fb3b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:46.981313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c8ee4e0-b4f5-4e25-8cdb-e264bf57fb3b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:47.059953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7c8ee4e0-b4f5-4e25-8cdb-e264bf57fb3b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090899 Jun 20 06:17:47.060602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 295/576] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jun 20 06:17:46 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:48.206211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-700df008-423d-4407-980f-4a06aeb71ca0 req-0c01fa4d-086a-42ae-9d72-f3cc07988500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f341d742-be1b-4305-96ef-cebe35a09f86", "tag": "19241efd-327c-488f-b71f-e1053dad3a90"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:48.215495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-700df008-423d-4407-980f-4a06aeb71ca0 req-0c01fa4d-086a-42ae-9d72-f3cc07988500 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:48.215940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-700df008-423d-4407-980f-4a06aeb71ca0 req-0c01fa4d-086a-42ae-9d72-f3cc07988500 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:48.226644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-700df008-423d-4407-980f-4a06aeb71ca0 req-0c01fa4d-086a-42ae-9d72-f3cc07988500 service nova] Creating event network-changed:19241efd-327c-488f-b71f-e1053dad3a90 for instance f341d742-be1b-4305-96ef-cebe35a09f86 on hv-cinder-80473 Jun 20 06:17:48.232667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-700df008-423d-4407-980f-4a06aeb71ca0 req-0c01fa4d-086a-42ae-9d72-f3cc07988500 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030063 Jun 20 06:17:48.233261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 282/577] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:51.123187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-37d537bb-1b44-4d0b-a3e5-d4c7cf6c88ad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:51.123719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-37d537bb-1b44-4d0b-a3e5-d4c7cf6c88ad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:51.125625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:51.131077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37d537bb-1b44-4d0b-a3e5-d4c7cf6c88ad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:51.131523 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37d537bb-1b44-4d0b-a3e5-d4c7cf6c88ad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:51.132289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37d537bb-1b44-4d0b-a3e5-d4c7cf6c88ad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:51.132729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37d537bb-1b44-4d0b-a3e5-d4c7cf6c88ad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:51.136641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:51.216165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-37d537bb-1b44-4d0b-a3e5-d4c7cf6c88ad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lazy-loading 'services' on Instance uuid c03d50ed-386e-42ee-af59-9a0231218aa2 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:17:51.287076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-37d537bb-1b44-4d0b-a3e5-d4c7cf6c88ad tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments/545dfaba-e787-4cad-a5e9-feab7b18fe13" status: 202 len: 0 microversion: 2.1 time: 0.168188 Jun 20 06:17:51.287784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 296/578] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:17:51 2022] DELETE /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments/545dfaba-e787-4cad-a5e9-feab7b18fe13 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:17:51.297161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4bff8474-0ec4-4db0-b97c-01ded079dec1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:51.298326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4bff8474-0ec4-4db0-b97c-01ded079dec1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:51.300251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:51.307767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bff8474-0ec4-4db0-b97c-01ded079dec1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:51.308750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bff8474-0ec4-4db0-b97c-01ded079dec1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:51.309101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bff8474-0ec4-4db0-b97c-01ded079dec1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:51.309613 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bff8474-0ec4-4db0-b97c-01ded079dec1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:51.312745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:51.346509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4bff8474-0ec4-4db0-b97c-01ded079dec1 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054087 Jun 20 06:17:51.347058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 283/579] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:17:51 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:17:52.359440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-adea7b58-e7cd-418c-a631-ac51e39f847d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:52.360483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-adea7b58-e7cd-418c-a631-ac51e39f847d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:52.366701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adea7b58-e7cd-418c-a631-ac51e39f847d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:52.367140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adea7b58-e7cd-418c-a631-ac51e39f847d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:52.367884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adea7b58-e7cd-418c-a631-ac51e39f847d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:52.368313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adea7b58-e7cd-418c-a631-ac51e39f847d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:52.396423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-adea7b58-e7cd-418c-a631-ac51e39f847d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042511 Jun 20 06:17:52.396968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 297/580] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:17:52 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:17:52.469082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f11f6053-cc0b-4c52-918f-0b6c82b23cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:52.469681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f11f6053-cc0b-4c52-918f-0b6c82b23cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:52.476115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11f6053-cc0b-4c52-918f-0b6c82b23cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:52.476567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11f6053-cc0b-4c52-918f-0b6c82b23cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:52.477333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11f6053-cc0b-4c52-918f-0b6c82b23cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:52.477850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11f6053-cc0b-4c52-918f-0b6c82b23cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:52.502954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f11f6053-cc0b-4c52-918f-0b6c82b23cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:17:52.578465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f11f6053-cc0b-4c52-918f-0b6c82b23cdc tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 204 len: 0 microversion: 2.1 time: 0.112936 Jun 20 06:17:52.579083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 284/581] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:17:52 2022] DELETE /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:17:52.587472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad114795-c2c2-45e4-a278-832c7dbf5cea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:52.588038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ad114795-c2c2-45e4-a278-832c7dbf5cea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:52.595243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad114795-c2c2-45e4-a278-832c7dbf5cea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:52.595693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad114795-c2c2-45e4-a278-832c7dbf5cea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:52.596459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad114795-c2c2-45e4-a278-832c7dbf5cea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:52.596892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad114795-c2c2-45e4-a278-832c7dbf5cea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:52.730384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ad114795-c2c2-45e4-a278-832c7dbf5cea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:52.737834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ad114795-c2c2-45e4-a278-832c7dbf5cea tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1691 microversion: 2.1 time: 0.154396 Jun 20 06:17:52.738394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 298/582] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:52 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:53.755721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-281a0422-d60b-47b6-a93f-521b0eef7aa4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:53.756478 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-281a0422-d60b-47b6-a93f-521b0eef7aa4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:53.763616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-281a0422-d60b-47b6-a93f-521b0eef7aa4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:53.764065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-281a0422-d60b-47b6-a93f-521b0eef7aa4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:53.764819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-281a0422-d60b-47b6-a93f-521b0eef7aa4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:53.765251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-281a0422-d60b-47b6-a93f-521b0eef7aa4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:53.894466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-281a0422-d60b-47b6-a93f-521b0eef7aa4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:53.902165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-281a0422-d60b-47b6-a93f-521b0eef7aa4 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1691 microversion: 2.1 time: 0.150789 Jun 20 06:17:53.902742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 285/583] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:53 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:54.919668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b9770678-8d56-46df-b500-f69d0afadb2c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:54.920273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b9770678-8d56-46df-b500-f69d0afadb2c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:54.926747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b9770678-8d56-46df-b500-f69d0afadb2c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:54.927184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b9770678-8d56-46df-b500-f69d0afadb2c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:54.927935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b9770678-8d56-46df-b500-f69d0afadb2c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:54.928367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b9770678-8d56-46df-b500-f69d0afadb2c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.061320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b9770678-8d56-46df-b500-f69d0afadb2c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:55.068738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b9770678-8d56-46df-b500-f69d0afadb2c tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1691 microversion: 2.1 time: 0.153567 Jun 20 06:17:55.069292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 299/584] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:54 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:56.085794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7c5278f5-6048-4087-b5e8-111e38bde37a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:56.086402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7c5278f5-6048-4087-b5e8-111e38bde37a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:56.093593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c5278f5-6048-4087-b5e8-111e38bde37a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.094044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c5278f5-6048-4087-b5e8-111e38bde37a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.094795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c5278f5-6048-4087-b5e8-111e38bde37a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.095227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c5278f5-6048-4087-b5e8-111e38bde37a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.225404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7c5278f5-6048-4087-b5e8-111e38bde37a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:56.232884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7c5278f5-6048-4087-b5e8-111e38bde37a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1691 microversion: 2.1 time: 0.150880 Jun 20 06:17:56.233457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 286/585] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:56 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:56.353308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-711a0140-7a11-4d9b-9abc-292f6ca08001 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:56.354208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-711a0140-7a11-4d9b-9abc-292f6ca08001 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:56.361727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-711a0140-7a11-4d9b-9abc-292f6ca08001 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.362170 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-711a0140-7a11-4d9b-9abc-292f6ca08001 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.362922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-711a0140-7a11-4d9b-9abc-292f6ca08001 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.363345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-711a0140-7a11-4d9b-9abc-292f6ca08001 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.391244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-711a0140-7a11-4d9b-9abc-292f6ca08001 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043275 Jun 20 06:17:56.391800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 300/586] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:17:56 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:17:56.448112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-65434e1b-56ed-4cad-aace-bbe3142f1de3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:56.448669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-65434e1b-56ed-4cad-aace-bbe3142f1de3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:56.454431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65434e1b-56ed-4cad-aace-bbe3142f1de3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.454874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65434e1b-56ed-4cad-aace-bbe3142f1de3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.455632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65434e1b-56ed-4cad-aace-bbe3142f1de3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.456064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65434e1b-56ed-4cad-aace-bbe3142f1de3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.482190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-65434e1b-56ed-4cad-aace-bbe3142f1de3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:17:56.560146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-65434e1b-56ed-4cad-aace-bbe3142f1de3 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 204 len: 0 microversion: 2.1 time: 0.115834 Jun 20 06:17:56.560807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 287/587] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:17:56 2022] DELETE /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:17:56.568939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-075eb6e1-bae2-41d9-aa1a-b6dd7c27b981 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:56.569578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-075eb6e1-bae2-41d9-aa1a-b6dd7c27b981 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:56.575768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-075eb6e1-bae2-41d9-aa1a-b6dd7c27b981 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.576208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-075eb6e1-bae2-41d9-aa1a-b6dd7c27b981 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.576963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-075eb6e1-bae2-41d9-aa1a-b6dd7c27b981 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.577406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-075eb6e1-bae2-41d9-aa1a-b6dd7c27b981 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.828641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-075eb6e1-bae2-41d9-aa1a-b6dd7c27b981 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:56.836026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-075eb6e1-bae2-41d9-aa1a-b6dd7c27b981 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1671 microversion: 2.1 time: 0.270979 Jun 20 06:17:56.836678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 301/588] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:56 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1671 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:57.250574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f93af09-84ed-42e5-b05d-bcbda3aed7ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:57.251258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f93af09-84ed-42e5-b05d-bcbda3aed7ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:57.257700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f93af09-84ed-42e5-b05d-bcbda3aed7ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:57.258154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f93af09-84ed-42e5-b05d-bcbda3aed7ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:57.258917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f93af09-84ed-42e5-b05d-bcbda3aed7ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:57.259346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f93af09-84ed-42e5-b05d-bcbda3aed7ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:57.342496 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f93af09-84ed-42e5-b05d-bcbda3aed7ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:57.350441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f93af09-84ed-42e5-b05d-bcbda3aed7ee tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 200 len: 1623 microversion: 2.1 time: 0.103709 Jun 20 06:17:57.353282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-37701287-d06a-42ca-8e54-8d267ad1df02 req-950b2833-ea17-44d6-b46a-919369c862d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03d50ed-386e-42ee-af59-9a0231218aa2", "name": "network-vif-deleted", "tag": "dd50376a-5980-4629-b056-2a634e6fb53b"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:57.359955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 288/589] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:57 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 1623 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:57.362514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-37701287-d06a-42ca-8e54-8d267ad1df02 req-950b2833-ea17-44d6-b46a-919369c862d7 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:57.362975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-37701287-d06a-42ca-8e54-8d267ad1df02 req-950b2833-ea17-44d6-b46a-919369c862d7 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:57.374053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-37701287-d06a-42ca-8e54-8d267ad1df02 req-950b2833-ea17-44d6-b46a-919369c862d7 service nova] Creating event network-vif-deleted:dd50376a-5980-4629-b056-2a634e6fb53b for instance c03d50ed-386e-42ee-af59-9a0231218aa2 on hv-cinder-80473 Jun 20 06:17:57.379253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-37701287-d06a-42ca-8e54-8d267ad1df02 req-950b2833-ea17-44d6-b46a-919369c862d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029568 Jun 20 06:17:57.379988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 302/590] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:17:57.853391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-51f84297-46f1-4777-a607-5ebfc5cca07f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:57.854783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-51f84297-46f1-4777-a607-5ebfc5cca07f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:57.860663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51f84297-46f1-4777-a607-5ebfc5cca07f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:57.861118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51f84297-46f1-4777-a607-5ebfc5cca07f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:57.861927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51f84297-46f1-4777-a607-5ebfc5cca07f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:57.862368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51f84297-46f1-4777-a607-5ebfc5cca07f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:57.992929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-51f84297-46f1-4777-a607-5ebfc5cca07f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:58.001355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-51f84297-46f1-4777-a607-5ebfc5cca07f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1671 microversion: 2.1 time: 0.151819 Jun 20 06:17:58.001943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 289/591] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:57 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:58.368851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:58.370217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: c03d50ed-386e-42ee-af59-9a0231218aa2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:58.381864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:58.382589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:58.383533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:58.384123 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:58.405493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] HTTP exception thrown: Instance c03d50ed-386e-42ee-af59-9a0231218aa2 could not be found. Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Request method failure captured: Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 HTTP/1.1 Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA-DER0TG_EM_kUuulCfSmaf9yvnYbEs_HSUaTrJaHJEUGAeVmc3ObCznlmOxH_83TrveBUV0DgjahoYMfkSeQpz3PDbaMeXgNR0mG3qwNqVtYM9gBT9zPehd8pj9OgXcyTcHyYvPalcO7ldwHo-KFRZP22X4GqW06N6olXwdZB2rwE Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:17:58.407866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}] Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: f49340b89c2a43b288572263ddac7be8 Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance c03d50ed-386e-42ee-af59-9a0231218aa2 could not be found. Jun 20 06:17:58.409301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'c03d50ed-386e-42ee-af59-9a0231218aa2'} Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03d50ed-386e-42ee-af59-9a0231218aa2 could not be found. Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:17:58.410228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03d50ed-386e-42ee-af59-9a0231218aa2 could not be found. Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03d50ed-386e-42ee-af59-9a0231218aa2 could not be found. Jun 20 06:17:58.411503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:17:58.412604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Returning 404 to user: Instance c03d50ed-386e-42ee-af59-9a0231218aa2 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:17:58.412604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f48a9943-0489-4601-8ca0-4b3b58c3bb33 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2" status: 404 len: 111 microversion: 2.1 time: 0.045592 Jun 20 06:17:58.419382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f9168aa4-0ccb-4c1b-8844-a9f337de6e14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '.version_select at 0x7f7a7a740820>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:58.423142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 303/592] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:58 2022] GET /compute/v2.1/servers/c03d50ed-386e-42ee-af59-9a0231218aa2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:17:58.438431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f9168aa4-0ccb-4c1b-8844-a9f337de6e14 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341433137" status: 202 len: 0 microversion: 2.1 time: 0.023736 Jun 20 06:17:58.439298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 290/593] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Jun 20 06:17:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341433137 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:17:59.019984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eaf5e832-aee7-4500-9f7c-f25c76803f7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:59.020601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eaf5e832-aee7-4500-9f7c-f25c76803f7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:59.026943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eaf5e832-aee7-4500-9f7c-f25c76803f7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:59.027400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eaf5e832-aee7-4500-9f7c-f25c76803f7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:59.028172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eaf5e832-aee7-4500-9f7c-f25c76803f7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:59.028800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eaf5e832-aee7-4500-9f7c-f25c76803f7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:59.120388 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eaf5e832-aee7-4500-9f7c-f25c76803f7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:59.129904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eaf5e832-aee7-4500-9f7c-f25c76803f7b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 200 len: 1605 microversion: 2.1 time: 0.112530 Jun 20 06:17:59.131730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 304/594] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:59 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 1605 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:59.396368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-93df44f4-963f-4471-9ae4-1dba215e0057 req-ad730568-6b0e-46aa-ad61-f4f3d66abba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7697c07f-5fd2-4b76-87af-0cb70746a73e", "name": "network-vif-deleted", "tag": "6ace4e19-63bf-4af0-8997-ab7c43711b52"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:59.406391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-93df44f4-963f-4471-9ae4-1dba215e0057 req-ad730568-6b0e-46aa-ad61-f4f3d66abba8 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:59.406829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-93df44f4-963f-4471-9ae4-1dba215e0057 req-ad730568-6b0e-46aa-ad61-f4f3d66abba8 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:59.418402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-93df44f4-963f-4471-9ae4-1dba215e0057 req-ad730568-6b0e-46aa-ad61-f4f3d66abba8 service nova] Creating event network-vif-deleted:6ace4e19-63bf-4af0-8997-ab7c43711b52 for instance 7697c07f-5fd2-4b76-87af-0cb70746a73e on hv-cinder-80473 Jun 20 06:17:59.423803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-93df44f4-963f-4471-9ae4-1dba215e0057 req-ad730568-6b0e-46aa-ad61-f4f3d66abba8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031798 Jun 20 06:17:59.424764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 291/595] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:00.149728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:00.150862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:00.157743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:00.158440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:00.159182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:00.159679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:00.174180 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] HTTP exception thrown: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Request method failure captured: Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e HTTP/1.1 Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA-HzYfKGXXn1JM9qLnTlmhvP6h2x1xD7-vRvgBIb23FdL6OabyctOXlI6yyRuJRvb1G0FSJ7bs6qE-AtnIF3UhMt60mmAxs09JDeWfBbnX7UBAv6Tm9cdScWGs4ocYApP8MjOTxtg7sz-FUZ4RiHcnS2gmqLsu3-kjebkfqQUs7PWw Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:18:00.175712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}] Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 14bf1845390b4c7880c04ae568aea00a Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:18:00.177369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '7697c07f-5fd2-4b76-87af-0cb70746a73e'} Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:18:00.178571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:18:00.179803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:00.181018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Returning 404 to user: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:18:00.181018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b5948ba1-6107-41bc-a8ec-505e13c40315 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 404 len: 111 microversion: 2.1 time: 0.031421 Jun 20 06:18:00.181018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 305/596] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:00 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:18:00.188026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d33afe58-7424-47d4-a5b2-f6648edcfc8b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '.version_select at 0x7f7a7afe8790>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:00.206742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d33afe58-7424-47d4-a5b2-f6648edcfc8b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233030990" status: 202 len: 0 microversion: 2.1 time: 0.023212 Jun 20 06:18:00.207593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 292/597] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Jun 20 06:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233030990 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:18:00.852186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-43055f10-b9f8-4404-abb3-9a756ad9f515 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'create', calling method: .version_select at 0x7f7a7a7861f0>, body: {"keypair": {"name": "tempest-keypair-770341914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtDrjDeON8aO3wSjFWhgvxjve14Q62KxoL9gID0gx99DcQq3UiXZ3Uh4MVnHj5BPLpQQdj92IhdHxIbXU9hsh9a85gXQ/Xpn5uRPeqP4h5RPNpvnqoSl7vwqTfTbpp56A=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:00.866070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-43055f10-b9f8-4404-abb3-9a756ad9f515 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Getting quotas for project 018cb579b1dd49db9062d4ddab9c9154. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:00.869952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-43055f10-b9f8-4404-abb3-9a756ad9f515 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Getting quotas for user 14bf1845390b4c7880c04ae568aea00a and project 018cb579b1dd49db9062d4ddab9c9154. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:00.893101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-43055f10-b9f8-4404-abb3-9a756ad9f515 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044828 Jun 20 06:18:00.893772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 306/598] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:18:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:01.351726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a616569b-b315-4c10-8cf1-808884548925 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:01.352345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a616569b-b315-4c10-8cf1-808884548925 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:01.360014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a616569b-b315-4c10-8cf1-808884548925 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:01.360472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a616569b-b315-4c10-8cf1-808884548925 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:01.361239 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a616569b-b315-4c10-8cf1-808884548925 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:01.361710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a616569b-b315-4c10-8cf1-808884548925 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:01.388170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a616569b-b315-4c10-8cf1-808884548925 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:18:01.468481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a616569b-b315-4c10-8cf1-808884548925 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 204 len: 0 microversion: 2.1 time: 0.120752 Jun 20 06:18:01.469202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 293/599] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:18:01 2022] DELETE /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:18:01.481918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-510d63f4-f6a1-4f00-8488-aa60a4824f4d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:01.482533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-510d63f4-f6a1-4f00-8488-aa60a4824f4d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:01.490098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-510d63f4-f6a1-4f00-8488-aa60a4824f4d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:01.490543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-510d63f4-f6a1-4f00-8488-aa60a4824f4d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:01.491311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-510d63f4-f6a1-4f00-8488-aa60a4824f4d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:01.491743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-510d63f4-f6a1-4f00-8488-aa60a4824f4d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:01.868798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-510d63f4-f6a1-4f00-8488-aa60a4824f4d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:01.876872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-510d63f4-f6a1-4f00-8488-aa60a4824f4d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1509 microversion: 2.1 time: 0.403294 Jun 20 06:18:01.877450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 307/600] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:01 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:02.321247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1244898939", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a24e9929-a8f4-4e74-b08f-51c705db0e5f"}], "security_groups": [{"name": "tempest-securitygroup--279668240"}], "key_name": "tempest-keypair-770341914", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:02.487622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] validate_networks() for [('a24e9929-a8f4-4e74-b08f-51c705db0e5f', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:18:02.894430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f3cbca05-885e-4bed-ad9a-54861509f3f5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:02.895066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f3cbca05-885e-4bed-ad9a-54861509f3f5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:02.901132 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3cbca05-885e-4bed-ad9a-54861509f3f5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:02.901634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3cbca05-885e-4bed-ad9a-54861509f3f5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:02.902403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3cbca05-885e-4bed-ad9a-54861509f3f5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:02.902838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3cbca05-885e-4bed-ad9a-54861509f3f5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:03.205237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f3cbca05-885e-4bed-ad9a-54861509f3f5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:03.212546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:18:03.213554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:18:03.214027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:18:03.214438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:18:03.214850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:18:03.221080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f3cbca05-885e-4bed-ad9a-54861509f3f5 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 200 len: 1509 microversion: 2.1 time: 0.330776 Jun 20 06:18:03.226829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 308/601] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:02 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:03.230197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:03.231180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:03.231985 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:03.232623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:03.252182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-b2f96d92-8387-4eea-b704-f41dc9814f09 req-b0b2ba57-0292-4532-82e0-457c541620c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b369f9fb-8948-4eaf-994c-8b63e2198df3", "name": "network-vif-deleted", "tag": "9d37c204-45f0-4ee3-81f7-0926b5433cec"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:03.257750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Getting quotas for project 018cb579b1dd49db9062d4ddab9c9154. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:03.262706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Getting quotas for user 14bf1845390b4c7880c04ae568aea00a and project 018cb579b1dd49db9062d4ddab9c9154. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:03.266191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-b2f96d92-8387-4eea-b704-f41dc9814f09 req-b0b2ba57-0292-4532-82e0-457c541620c7 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:03.267437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-b2f96d92-8387-4eea-b704-f41dc9814f09 req-b0b2ba57-0292-4532-82e0-457c541620c7 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:03.274700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:18:03.278559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:18:03.282546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-b2f96d92-8387-4eea-b704-f41dc9814f09 req-b0b2ba57-0292-4532-82e0-457c541620c7 service nova] Creating event network-vif-deleted:9d37c204-45f0-4ee3-81f7-0926b5433cec for instance b369f9fb-8948-4eaf-994c-8b63e2198df3 on hv-cinder-80473 Jun 20 06:18:03.289726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-b2f96d92-8387-4eea-b704-f41dc9814f09 req-b0b2ba57-0292-4532-82e0-457c541620c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040929 Jun 20 06:18:03.291911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 309/602] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:03.333024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a9356e0e-b429-4896-8881-432ea55753d7 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.016374 Jun 20 06:18:03.333864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 294/603] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:18:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:18:03.345443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-85687dbf-67ca-4781-ab09-4b09a7307a8f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:03.346186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-85687dbf-67ca-4781-ab09-4b09a7307a8f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:03.413545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-85687dbf-67ca-4781-ab09-4b09a7307a8f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:03.421088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-85687dbf-67ca-4781-ab09-4b09a7307a8f tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1237 microversion: 2.1 time: 0.079961 Jun 20 06:18:03.421727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 310/604] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:03 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:04.244734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:04.245451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: b369f9fb-8948-4eaf-994c-8b63e2198df3] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:04.252524 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.252975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.253817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.254253 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.267052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] HTTP exception thrown: Instance b369f9fb-8948-4eaf-994c-8b63e2198df3 could not be found. Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Request method failure captured: Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 HTTP/1.1 Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA-DER0TG_EM_kUuulCfSmaf9yvnYbEs_HSUaTrJaHJEUGAeVmc3ObCznlmOxH_83TrveBUV0DgjahoYMfkSeQpz3PDbaMeXgNR0mG3qwNqVtYM9gBT9zPehd8pj9OgXcyTcHyYvPalcO7ldwHo-KFRZP22X4GqW06N6olXwdZB2rwE Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:18:04.268678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}] Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: f49340b89c2a43b288572263ddac7be8 Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance b369f9fb-8948-4eaf-994c-8b63e2198df3 could not be found. Jun 20 06:18:04.270465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': 'b369f9fb-8948-4eaf-994c-8b63e2198df3'} Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b369f9fb-8948-4eaf-994c-8b63e2198df3 could not be found. Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:18:04.271340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b369f9fb-8948-4eaf-994c-8b63e2198df3 could not be found. Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b369f9fb-8948-4eaf-994c-8b63e2198df3 could not be found. Jun 20 06:18:04.272720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:18:04.274181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Returning 404 to user: Instance b369f9fb-8948-4eaf-994c-8b63e2198df3 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:18:04.274181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f0975f4-3fd8-425e-8341-afe2db63fbc0 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3" status: 404 len: 111 microversion: 2.1 time: 0.030229 Jun 20 06:18:04.274181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 295/605] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:04 2022] GET /compute/v2.1/servers/b369f9fb-8948-4eaf-994c-8b63e2198df3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:18:04.280272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-19b21596-b3c6-42f8-8d21-e770990ae88d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:04.280767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-19b21596-b3c6-42f8-8d21-e770990ae88d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:04.287612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19b21596-b3c6-42f8-8d21-e770990ae88d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.288065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19b21596-b3c6-42f8-8d21-e770990ae88d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.288846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19b21596-b3c6-42f8-8d21-e770990ae88d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.289266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19b21596-b3c6-42f8-8d21-e770990ae88d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.314205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-19b21596-b3c6-42f8-8d21-e770990ae88d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:18:04.391501 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-19b21596-b3c6-42f8-8d21-e770990ae88d tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "DELETE /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 204 len: 0 microversion: 2.1 time: 0.115991 Jun 20 06:18:04.392093 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 311/606] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:18:04 2022] DELETE /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:18:04.401634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ae80d4bc-ec98-46f9-831b-005e17b2889a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:04.402579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ae80d4bc-ec98-46f9-831b-005e17b2889a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:04.409330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae80d4bc-ec98-46f9-831b-005e17b2889a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.409814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae80d4bc-ec98-46f9-831b-005e17b2889a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.410589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae80d4bc-ec98-46f9-831b-005e17b2889a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.411020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae80d4bc-ec98-46f9-831b-005e17b2889a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.438982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5ac23dae-9de5-470a-8fc1-26846be7b37e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:04.439762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5ac23dae-9de5-470a-8fc1-26846be7b37e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:04.445787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ac23dae-9de5-470a-8fc1-26846be7b37e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.446235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ac23dae-9de5-470a-8fc1-26846be7b37e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.447535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ac23dae-9de5-470a-8fc1-26846be7b37e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.448143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ac23dae-9de5-470a-8fc1-26846be7b37e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.527505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5ac23dae-9de5-470a-8fc1-26846be7b37e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:04.535036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5ac23dae-9de5-470a-8fc1-26846be7b37e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1297 microversion: 2.1 time: 0.100461 Jun 20 06:18:04.535604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 312/607] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:04 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:04.574252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ae80d4bc-ec98-46f9-831b-005e17b2889a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:04.581924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ae80d4bc-ec98-46f9-831b-005e17b2889a tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.185276 Jun 20 06:18:04.582475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 296/608] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:04 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:05.552047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c6775d5c-cad0-4d50-8789-fa1258e9267b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:05.552659 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c6775d5c-cad0-4d50-8789-fa1258e9267b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:05.559253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6775d5c-cad0-4d50-8789-fa1258e9267b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:05.559699 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6775d5c-cad0-4d50-8789-fa1258e9267b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:05.560463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6775d5c-cad0-4d50-8789-fa1258e9267b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:05.560897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6775d5c-cad0-4d50-8789-fa1258e9267b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:05.599678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3f30bd09-e29b-4bd0-85ff-05ba86b37e00 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:05.600286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3f30bd09-e29b-4bd0-85ff-05ba86b37e00 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:05.607753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f30bd09-e29b-4bd0-85ff-05ba86b37e00 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:05.608361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f30bd09-e29b-4bd0-85ff-05ba86b37e00 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:05.609174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f30bd09-e29b-4bd0-85ff-05ba86b37e00 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:05.609632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f30bd09-e29b-4bd0-85ff-05ba86b37e00 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:05.623443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c6775d5c-cad0-4d50-8789-fa1258e9267b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:05.631475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c6775d5c-cad0-4d50-8789-fa1258e9267b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1307 microversion: 2.1 time: 0.083355 Jun 20 06:18:05.632042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 313/609] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:05 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1307 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:05.743233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3f30bd09-e29b-4bd0-85ff-05ba86b37e00 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:05.751185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3f30bd09-e29b-4bd0-85ff-05ba86b37e00 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.155336 Jun 20 06:18:05.751749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 297/610] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:05 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:06.648136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f22d0398-7344-4fa0-aebb-f14bb8a57264 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:06.648745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f22d0398-7344-4fa0-aebb-f14bb8a57264 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:06.655437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f22d0398-7344-4fa0-aebb-f14bb8a57264 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:06.655882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f22d0398-7344-4fa0-aebb-f14bb8a57264 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:06.656639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f22d0398-7344-4fa0-aebb-f14bb8a57264 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:06.657073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f22d0398-7344-4fa0-aebb-f14bb8a57264 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:06.717573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f22d0398-7344-4fa0-aebb-f14bb8a57264 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:06.724754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f22d0398-7344-4fa0-aebb-f14bb8a57264 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1295 microversion: 2.1 time: 0.080714 Jun 20 06:18:06.725318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 314/611] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:06 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1295 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:06.768106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ceb125bb-5326-4a9d-8557-5473f991e8ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:06.768738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ceb125bb-5326-4a9d-8557-5473f991e8ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:06.775623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb125bb-5326-4a9d-8557-5473f991e8ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:06.776081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb125bb-5326-4a9d-8557-5473f991e8ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:06.776839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb125bb-5326-4a9d-8557-5473f991e8ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:06.777269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ceb125bb-5326-4a9d-8557-5473f991e8ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:06.975299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ceb125bb-5326-4a9d-8557-5473f991e8ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49340b89c2a43b288572263ddac7be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0614a239ccf84b5da75a269f3a0c6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:06.977750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:06.987811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ceb125bb-5326-4a9d-8557-5473f991e8ff tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 200 len: 1522 microversion: 2.1 time: 0.223249 Jun 20 06:18:06.988742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 298/612] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:06 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:07.539017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-89f52f5c-7d2a-4266-8547-d4a97eeb27d1 req-05713d1d-f1ff-401d-9338-54cbafc00647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d", "name": "network-vif-deleted", "tag": "478aa840-55c2-4787-a84e-c8aa250b5fb0"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:07.548770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-89f52f5c-7d2a-4266-8547-d4a97eeb27d1 req-05713d1d-f1ff-401d-9338-54cbafc00647 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:07.549493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-89f52f5c-7d2a-4266-8547-d4a97eeb27d1 req-05713d1d-f1ff-401d-9338-54cbafc00647 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:07.554818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:07.568919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-89f52f5c-7d2a-4266-8547-d4a97eeb27d1 req-05713d1d-f1ff-401d-9338-54cbafc00647 service nova] Creating event network-vif-deleted:478aa840-55c2-4787-a84e-c8aa250b5fb0 for instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d on hv-cinder-80473 Jun 20 06:18:07.576681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-89f52f5c-7d2a-4266-8547-d4a97eeb27d1 req-05713d1d-f1ff-401d-9338-54cbafc00647 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135807 Jun 20 06:18:07.581560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 315/613] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:07.747353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-73631feb-0021-44a2-b321-6cf0b7191c18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:07.747967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-73631feb-0021-44a2-b321-6cf0b7191c18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:07.756769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73631feb-0021-44a2-b321-6cf0b7191c18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:07.757241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73631feb-0021-44a2-b321-6cf0b7191c18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:07.758628 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73631feb-0021-44a2-b321-6cf0b7191c18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:07.760142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73631feb-0021-44a2-b321-6cf0b7191c18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:07.992259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-73631feb-0021-44a2-b321-6cf0b7191c18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:08.003092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-73631feb-0021-44a2-b321-6cf0b7191c18 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1362 microversion: 2.1 time: 0.264079 Jun 20 06:18:08.004004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 299/614] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:07 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:08.012073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:08.013362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] [instance: 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:08.022121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:08.023368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:08.024393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:08.025160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:08.041705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] HTTP exception thrown: Instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d could not be found. Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Request method failure captured: Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d HTTP/1.1 Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA-DER0TG_EM_kUuulCfSmaf9yvnYbEs_HSUaTrJaHJEUGAeVmc3ObCznlmOxH_83TrveBUV0DgjahoYMfkSeQpz3PDbaMeXgNR0mG3qwNqVtYM9gBT9zPehd8pj9OgXcyTcHyYvPalcO7ldwHo-KFRZP22X4GqW06N6olXwdZB2rwE Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:18:08.043358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0614a239ccf84b5da75a269f3a0c6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0614a239ccf84b5da75a269f3a0c6363"}]}] Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 0614a239ccf84b5da75a269f3a0c6363 Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122583815 Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: f49340b89c2a43b288572263ddac7be8 Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122583815-project Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d could not be found. Jun 20 06:18:08.044902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d'} Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d could not be found. Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:18:08.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d could not be found. Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d could not be found. Jun 20 06:18:08.047003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:08.048090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] Returning 404 to user: Instance 50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:18:08.048090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e7ed1c54-683c-439c-a3a0-8c510b9a8846 tempest-ServerRescueNegativeTestJSON-2122583815 tempest-ServerRescueNegativeTestJSON-2122583815-project] 10.222.0.16 "GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d" status: 404 len: 111 microversion: 2.1 time: 0.038537 Jun 20 06:18:08.048090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 316/615] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:08 2022] GET /compute/v2.1/servers/50c3f921-2aaf-40ba-8c16-f3c4c7ce6b7d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:18:08.387624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-22c62125-194b-4062-8be2-c76df1ded088 req-a228b6c3-e8a7-4491-a692-964d11951660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36614b0c-286e-453d-86f6-88d8150ff347", "tag": "5a3ee1e2-f316-4cb3-a668-cca2f797fceb"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:08.404521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-22c62125-194b-4062-8be2-c76df1ded088 req-a228b6c3-e8a7-4491-a692-964d11951660 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:08.404967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-22c62125-194b-4062-8be2-c76df1ded088 req-a228b6c3-e8a7-4491-a692-964d11951660 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:08.424049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-22c62125-194b-4062-8be2-c76df1ded088 req-a228b6c3-e8a7-4491-a692-964d11951660 service nova] Creating event network-changed:5a3ee1e2-f316-4cb3-a668-cca2f797fceb for instance 36614b0c-286e-453d-86f6-88d8150ff347 on hv-cinder-80473 Jun 20 06:18:08.429941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-22c62125-194b-4062-8be2-c76df1ded088 req-a228b6c3-e8a7-4491-a692-964d11951660 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047464 Jun 20 06:18:08.430543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 300/616] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:08.792778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0aa50bcc-ad62-4551-aa30-1079b549ca5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:08.793609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0aa50bcc-ad62-4551-aa30-1079b549ca5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:08.800128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0aa50bcc-ad62-4551-aa30-1079b549ca5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:08.800575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0aa50bcc-ad62-4551-aa30-1079b549ca5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:08.801331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0aa50bcc-ad62-4551-aa30-1079b549ca5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:08.801957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0aa50bcc-ad62-4551-aa30-1079b549ca5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:08.828126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0aa50bcc-ad62-4551-aa30-1079b549ca5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:18:08.903452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0aa50bcc-ad62-4551-aa30-1079b549ca5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 204 len: 0 microversion: 2.1 time: 0.114748 Jun 20 06:18:08.904034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 317/617] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:18:08 2022] DELETE /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:18:08.912789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7a5f6e38-bd8b-4b2d-a39e-8559084d0315 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:08.913583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7a5f6e38-bd8b-4b2d-a39e-8559084d0315 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:08.920862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a5f6e38-bd8b-4b2d-a39e-8559084d0315 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:08.921408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a5f6e38-bd8b-4b2d-a39e-8559084d0315 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:08.922298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a5f6e38-bd8b-4b2d-a39e-8559084d0315 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:08.922830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a5f6e38-bd8b-4b2d-a39e-8559084d0315 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:09.020769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5fbddbcd-11a0-452b-97ae-4b1333acb750 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:09.021614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5fbddbcd-11a0-452b-97ae-4b1333acb750 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:09.028560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fbddbcd-11a0-452b-97ae-4b1333acb750 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:09.029002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fbddbcd-11a0-452b-97ae-4b1333acb750 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:09.029977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fbddbcd-11a0-452b-97ae-4b1333acb750 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:09.030407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fbddbcd-11a0-452b-97ae-4b1333acb750 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:09.069050 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7a5f6e38-bd8b-4b2d-a39e-8559084d0315 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:09.079801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7a5f6e38-bd8b-4b2d-a39e-8559084d0315 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1578 microversion: 2.1 time: 0.168816 Jun 20 06:18:09.080394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 301/618] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:08 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:09.171984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5fbddbcd-11a0-452b-97ae-4b1333acb750 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:09.179453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5fbddbcd-11a0-452b-97ae-4b1333acb750 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1362 microversion: 2.1 time: 0.163041 Jun 20 06:18:09.180022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 318/619] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:09 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:10.097290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-27f145ee-d08a-4535-a095-28c12763d605 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:10.098577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-27f145ee-d08a-4535-a095-28c12763d605 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:10.105555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27f145ee-d08a-4535-a095-28c12763d605 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:10.106009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27f145ee-d08a-4535-a095-28c12763d605 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:10.106789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27f145ee-d08a-4535-a095-28c12763d605 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:10.107228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27f145ee-d08a-4535-a095-28c12763d605 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:10.196023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-709cf50b-d348-45cf-86d5-71050a6d610d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:10.196633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-709cf50b-d348-45cf-86d5-71050a6d610d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:10.205896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-709cf50b-d348-45cf-86d5-71050a6d610d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:10.207062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-709cf50b-d348-45cf-86d5-71050a6d610d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:10.208090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-709cf50b-d348-45cf-86d5-71050a6d610d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:10.208828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-709cf50b-d348-45cf-86d5-71050a6d610d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:10.265838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-27f145ee-d08a-4535-a095-28c12763d605 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:10.274730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-27f145ee-d08a-4535-a095-28c12763d605 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1578 microversion: 2.1 time: 0.181395 Jun 20 06:18:10.276872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 302/620] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:10 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:10.374234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-709cf50b-d348-45cf-86d5-71050a6d610d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:10.381919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-709cf50b-d348-45cf-86d5-71050a6d610d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1362 microversion: 2.1 time: 0.189585 Jun 20 06:18:10.393905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 319/621] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:10 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:11.294460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d6788594-2f54-4d24-9a46-5bdd8fdd484e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:11.295284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d6788594-2f54-4d24-9a46-5bdd8fdd484e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:11.301800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6788594-2f54-4d24-9a46-5bdd8fdd484e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:11.308502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6788594-2f54-4d24-9a46-5bdd8fdd484e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:11.309662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6788594-2f54-4d24-9a46-5bdd8fdd484e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:11.310332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6788594-2f54-4d24-9a46-5bdd8fdd484e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:11.403210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8e5412e7-7e68-4044-a748-55d8a35480a4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:11.403964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8e5412e7-7e68-4044-a748-55d8a35480a4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:11.411001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e5412e7-7e68-4044-a748-55d8a35480a4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:11.411426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e5412e7-7e68-4044-a748-55d8a35480a4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:11.412191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e5412e7-7e68-4044-a748-55d8a35480a4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:11.412615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e5412e7-7e68-4044-a748-55d8a35480a4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:11.640538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d6788594-2f54-4d24-9a46-5bdd8fdd484e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:11.649290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d6788594-2f54-4d24-9a46-5bdd8fdd484e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1578 microversion: 2.1 time: 0.360041 Jun 20 06:18:11.650044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 303/622] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:11 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1578 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:11.699051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8e5412e7-7e68-4044-a748-55d8a35480a4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:11.709621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8e5412e7-7e68-4044-a748-55d8a35480a4 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1362 microversion: 2.1 time: 0.311045 Jun 20 06:18:11.710198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 320/623] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:11 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:12.670751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c208fa7-6e5c-4803-af63-a90180d359c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:12.671363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c208fa7-6e5c-4803-af63-a90180d359c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:12.677830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c208fa7-6e5c-4803-af63-a90180d359c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:12.678285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c208fa7-6e5c-4803-af63-a90180d359c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:12.679053 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c208fa7-6e5c-4803-af63-a90180d359c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:12.679495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c208fa7-6e5c-4803-af63-a90180d359c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:12.726891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0ca83515-b235-4584-85d9-81b6ae4f181d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:12.728660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0ca83515-b235-4584-85d9-81b6ae4f181d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:12.735231 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ca83515-b235-4584-85d9-81b6ae4f181d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:12.735608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ca83515-b235-4584-85d9-81b6ae4f181d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:12.736379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ca83515-b235-4584-85d9-81b6ae4f181d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:12.736828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ca83515-b235-4584-85d9-81b6ae4f181d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:12.888639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c208fa7-6e5c-4803-af63-a90180d359c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:12.897309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c208fa7-6e5c-4803-af63-a90180d359c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1578 microversion: 2.1 time: 0.230293 Jun 20 06:18:12.907627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 304/624] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:12 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1578 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:13.234023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0ca83515-b235-4584-85d9-81b6ae4f181d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:13.242577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0ca83515-b235-4584-85d9-81b6ae4f181d tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1362 microversion: 2.1 time: 0.520080 Jun 20 06:18:13.243385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 321/625] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:12 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:13.917442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b77767d6-eb50-465c-b147-2655d4df2f4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:13.918785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b77767d6-eb50-465c-b147-2655d4df2f4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:13.930090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:13.931358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:13.938322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b77767d6-eb50-465c-b147-2655d4df2f4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:13.939821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b77767d6-eb50-465c-b147-2655d4df2f4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:13.941981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b77767d6-eb50-465c-b147-2655d4df2f4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:13.943139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b77767d6-eb50-465c-b147-2655d4df2f4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:14.038898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b77767d6-eb50-465c-b147-2655d4df2f4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:14.050957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b77767d6-eb50-465c-b147-2655d4df2f4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 200 len: 1510 microversion: 2.1 time: 0.139460 Jun 20 06:18:14.064796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 305/626] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:13 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:14.112792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-16a19306-56f1-4e0e-a851-39df7497b1bb req-f4828e31-721a-4e5e-b2ab-bf743ab7e661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98adf6-82cd-42e0-b795-1bffcbe0f936", "name": "network-vif-deleted", "tag": "cdaf06e6-1942-4236-8f00-52b64279da15"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:14.116246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:14.128550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-16a19306-56f1-4e0e-a851-39df7497b1bb req-f4828e31-721a-4e5e-b2ab-bf743ab7e661 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:14.128989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-16a19306-56f1-4e0e-a851-39df7497b1bb req-f4828e31-721a-4e5e-b2ab-bf743ab7e661 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:14.148371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-16a19306-56f1-4e0e-a851-39df7497b1bb req-f4828e31-721a-4e5e-b2ab-bf743ab7e661 service nova] Creating event network-vif-deleted:cdaf06e6-1942-4236-8f00-52b64279da15 for instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 on hv-cinder-80473 Jun 20 06:18:14.159949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-16a19306-56f1-4e0e-a851-39df7497b1bb req-f4828e31-721a-4e5e-b2ab-bf743ab7e661 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050471 Jun 20 06:18:14.161308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 322/627] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:14.262402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-18563499-35a3-47af-8428-b4d0c186a3fb tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:14.263165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-18563499-35a3-47af-8428-b4d0c186a3fb tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:14.270070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18563499-35a3-47af-8428-b4d0c186a3fb tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:14.271205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18563499-35a3-47af-8428-b4d0c186a3fb tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:14.272089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18563499-35a3-47af-8428-b4d0c186a3fb tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:14.272743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18563499-35a3-47af-8428-b4d0c186a3fb tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:14.524255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-18563499-35a3-47af-8428-b4d0c186a3fb tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:14.533634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-18563499-35a3-47af-8428-b4d0c186a3fb tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1362 microversion: 2.1 time: 0.277324 Jun 20 06:18:14.534714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 306/628] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:14 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:15.070164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:15.071141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:15.090361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:15.103852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:15.106393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:15.116163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-a2cbfece-847a-41ee-a602-3f9eb79f1988 req-2bfb311d-9b50-452c-a275-eefb4d049bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36614b0c-286e-453d-86f6-88d8150ff347", "name": "network-vif-plugged", "status": "completed", "tag": "5a3ee1e2-f316-4cb3-a668-cca2f797fceb"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:15.120060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:15.127427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a2cbfece-847a-41ee-a602-3f9eb79f1988 req-2bfb311d-9b50-452c-a275-eefb4d049bff service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:15.129879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a2cbfece-847a-41ee-a602-3f9eb79f1988 req-2bfb311d-9b50-452c-a275-eefb4d049bff service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:15.139386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] HTTP exception thrown: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Request method failure captured: Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 HTTP/1.1 Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBBIcSH4qKhgDIC_c3zXiIPeDkT9cv9-cQzj4rb7_8kV9rdFCtVvM02VJ_3jWEDol9CucUcxnaYa2-JgFnAyD1yCot3qkKNZOC_pWkKjREP6M0ye9dLovRnB4uwzc33WKi4X7IHo_RQuBXbYWEiAaZmtSSyMYywmuWz_gyoZRi7r9Dg Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: a80966bf28184a9f8e9987632f7c0973 Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-TestVolumeBootPattern-728897810 Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:18:15.141463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a80966bf28184a9f8e9987632f7c0973"}]}] Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-TestVolumeBootPattern-728897810 Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: a80966bf28184a9f8e9987632f7c0973 Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-TestVolumeBootPattern-728897810 Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-TestVolumeBootPattern-728897810-project Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 6f577abe1ada45979d5cb550073ae6a8 Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-TestVolumeBootPattern-728897810-project Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:18:15.142880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '3b98adf6-82cd-42e0-b795-1bffcbe0f936'} Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:18:15.143611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:18:15.145016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:18:15.148951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-a2cbfece-847a-41ee-a602-3f9eb79f1988 req-2bfb311d-9b50-452c-a275-eefb4d049bff service nova] Creating event network-vif-plugged:5a3ee1e2-f316-4cb3-a668-cca2f797fceb for instance 36614b0c-286e-453d-86f6-88d8150ff347 on hv-cinder-80473 Jun 20 06:18:15.150767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Returning 404 to user: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:18:15.151900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-df73790b-d0eb-4d7c-b819-dd9c53d6e0fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 404 len: 111 microversion: 2.1 time: 0.086583 Jun 20 06:18:15.152996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 323/629] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:15 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:18:15.163856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-a2cbfece-847a-41ee-a602-3f9eb79f1988 req-2bfb311d-9b50-452c-a275-eefb4d049bff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051239 Jun 20 06:18:15.165189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 307/630] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:15.367132 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-367259840", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-447985312", "security_groups": [{"name": "tempest-secgroup-smoke-1692453996"}], "block_device_mapping_v2": [{"uuid": "3e94b42b-6785-4370-a8cd-5cd1badd405f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73f8a5ee-1f30-4c4c-9916-2c898a38860c"}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:15.526815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] validate_networks() for [('73f8a5ee-1f30-4c4c-9916-2c898a38860c', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:18:15.553763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c7a13a61-3aa2-45b5-90b3-37afdfb7c351 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:15.555175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c7a13a61-3aa2-45b5-90b3-37afdfb7c351 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:15.563343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7a13a61-3aa2-45b5-90b3-37afdfb7c351 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:15.563965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7a13a61-3aa2-45b5-90b3-37afdfb7c351 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:15.565313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7a13a61-3aa2-45b5-90b3-37afdfb7c351 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:15.566075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7a13a61-3aa2-45b5-90b3-37afdfb7c351 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:15.849340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c7a13a61-3aa2-45b5-90b3-37afdfb7c351 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:15.866848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c7a13a61-3aa2-45b5-90b3-37afdfb7c351 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1362 microversion: 2.1 time: 0.318026 Jun 20 06:18:15.868361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 308/631] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:15 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:16.270342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:18:16.270941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:18:16.271227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:18:16.271634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:18:16.272048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:18:16.283759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:16.284218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:16.286545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:16.287133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:16.336000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Getting quotas for project a80966bf28184a9f8e9987632f7c0973. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:16.340674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Getting quotas for user 6f577abe1ada45979d5cb550073ae6a8 and project a80966bf28184a9f8e9987632f7c0973. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:16.438994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:18:16.441465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e94b42b-6785-4370-a8cd-5cd1badd405f',volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:18:16.601781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fb9dc602-453c-47e0-9de9-42b71cb4209a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.240077 Jun 20 06:18:16.608878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 324/632] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:18:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:18:16.616101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60a267a6-af2b-4e1f-bee7-78ea6ebac17b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:16.617397 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-60a267a6-af2b-4e1f-bee7-78ea6ebac17b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:16.685475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-60a267a6-af2b-4e1f-bee7-78ea6ebac17b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:16.693852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-60a267a6-af2b-4e1f-bee7-78ea6ebac17b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1093 microversion: 2.1 time: 0.083159 Jun 20 06:18:16.703605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 309/633] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:16 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1093 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:16.887596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-771ea4de-74d4-47ad-b04e-bb1c107a25e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:16.888882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-771ea4de-74d4-47ad-b04e-bb1c107a25e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:16.900270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-771ea4de-74d4-47ad-b04e-bb1c107a25e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:16.903837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-771ea4de-74d4-47ad-b04e-bb1c107a25e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:16.905642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-771ea4de-74d4-47ad-b04e-bb1c107a25e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:16.906500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-771ea4de-74d4-47ad-b04e-bb1c107a25e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:17.105519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-771ea4de-74d4-47ad-b04e-bb1c107a25e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:17.114212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-771ea4de-74d4-47ad-b04e-bb1c107a25e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1549 microversion: 2.1 time: 0.232372 Jun 20 06:18:17.124368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 325/634] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:16 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1549 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:17.132076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7fb7b715-ac59-47d8-b714-25d03afd4606 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:17.132747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7fb7b715-ac59-47d8-b714-25d03afd4606 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:17.143051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fb7b715-ac59-47d8-b714-25d03afd4606 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:17.143664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fb7b715-ac59-47d8-b714-25d03afd4606 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:17.144899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fb7b715-ac59-47d8-b714-25d03afd4606 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:17.145881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fb7b715-ac59-47d8-b714-25d03afd4606 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:17.256977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7fb7b715-ac59-47d8-b714-25d03afd4606 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128639 Jun 20 06:18:17.258103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 310/635] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jun 20 06:18:17 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:17.736710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bc6f53b7-3a6c-42f2-b053-0006a48dcbc7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:17.737339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bc6f53b7-3a6c-42f2-b053-0006a48dcbc7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:17.746030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:17.760241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc6f53b7-3a6c-42f2-b053-0006a48dcbc7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:17.760701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc6f53b7-3a6c-42f2-b053-0006a48dcbc7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:17.761528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc6f53b7-3a6c-42f2-b053-0006a48dcbc7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:17.762010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc6f53b7-3a6c-42f2-b053-0006a48dcbc7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:17.845012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bc6f53b7-3a6c-42f2-b053-0006a48dcbc7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:17.855694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bc6f53b7-3a6c-42f2-b053-0006a48dcbc7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1191 microversion: 2.1 time: 0.148285 Jun 20 06:18:17.865790 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 326/636] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:17 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1191 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:18.729326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-585d07db-a155-4932-a933-be83e2ac9134 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Action: 'create', calling method: .version_select at 0x7f7a7a747b80>, body: {"keypair": {"name": "tempest-keypair-287983682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0fpxc6PKmqOr5AaBcQv0mW71Wof07SU4b9510dCsfWCJghXXZGi8kVsprioYW2AYAi/seNXf+bqrf9iJcKiymO51sVcYe4UdKFeqmd4p/IFC9w7GPXU9mrZuTXOp6teA=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:18.748325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-585d07db-a155-4932-a933-be83e2ac9134 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Getting quotas for project 8a2203406ec34776ab1a1e663601baaf. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:18.750980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:18.753890 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-585d07db-a155-4932-a933-be83e2ac9134 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Getting quotas for user 5fc0e8fe250349d699ea43aeee98170e and project 8a2203406ec34776ab1a1e663601baaf. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:18.781206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-585d07db-a155-4932-a933-be83e2ac9134 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.203299 Jun 20 06:18:18.782164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 311/637] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Jun 20 06:18:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 205 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 06:18:18.879138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f30ab24-d5e8-41ac-bc9b-fc755e201e80 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:18.879915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f30ab24-d5e8-41ac-bc9b-fc755e201e80 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:18.892418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f30ab24-d5e8-41ac-bc9b-fc755e201e80 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:18.894300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f30ab24-d5e8-41ac-bc9b-fc755e201e80 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:18.895341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f30ab24-d5e8-41ac-bc9b-fc755e201e80 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:18.896015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f30ab24-d5e8-41ac-bc9b-fc755e201e80 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:18.968022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-f4ff68c4-0279-49d4-9c89-139b8dd3d45a req-72f32710-264a-4042-80ac-f0bd3050d421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36614b0c-286e-453d-86f6-88d8150ff347", "tag": "5a3ee1e2-f316-4cb3-a668-cca2f797fceb"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:18.980643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-f4ff68c4-0279-49d4-9c89-139b8dd3d45a req-72f32710-264a-4042-80ac-f0bd3050d421 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:18.981783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-f4ff68c4-0279-49d4-9c89-139b8dd3d45a req-72f32710-264a-4042-80ac-f0bd3050d421 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:19.022606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-f4ff68c4-0279-49d4-9c89-139b8dd3d45a req-72f32710-264a-4042-80ac-f0bd3050d421 service nova] Creating event network-changed:5a3ee1e2-f316-4cb3-a668-cca2f797fceb for instance 36614b0c-286e-453d-86f6-88d8150ff347 on hv-cinder-80473 Jun 20 06:18:19.028660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7f30ab24-d5e8-41ac-bc9b-fc755e201e80 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:19.041835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-f4ff68c4-0279-49d4-9c89-139b8dd3d45a req-72f32710-264a-4042-80ac-f0bd3050d421 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077776 Jun 20 06:18:19.044649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 312/638] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:19.062511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f30ab24-d5e8-41ac-bc9b-fc755e201e80 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1209 microversion: 2.1 time: 0.191362 Jun 20 06:18:19.075953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 327/639] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:18 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:20.084231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2eabb5ac-9aec-4ab1-a16e-251168951e50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:20.086531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2eabb5ac-9aec-4ab1-a16e-251168951e50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:20.100118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2eabb5ac-9aec-4ab1-a16e-251168951e50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:20.101616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2eabb5ac-9aec-4ab1-a16e-251168951e50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:20.102623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2eabb5ac-9aec-4ab1-a16e-251168951e50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:20.103272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2eabb5ac-9aec-4ab1-a16e-251168951e50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:20.297152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2eabb5ac-9aec-4ab1-a16e-251168951e50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:20.308172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2eabb5ac-9aec-4ab1-a16e-251168951e50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.230376 Jun 20 06:18:20.310805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 313/640] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:20 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:20.559810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-cf5fb1b3-4599-4d89-872b-09045d5480f8 req-d0503619-8f51-48e7-8fe2-18818d44273f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32410ddb-881f-46f6-b3c6-67399fd5b53b", "tag": "047b28e6-c7ee-4057-bd43-5589a50b5f51"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:20.582813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-cf5fb1b3-4599-4d89-872b-09045d5480f8 req-d0503619-8f51-48e7-8fe2-18818d44273f service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:20.585149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-cf5fb1b3-4599-4d89-872b-09045d5480f8 req-d0503619-8f51-48e7-8fe2-18818d44273f service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:20.619060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-cf5fb1b3-4599-4d89-872b-09045d5480f8 req-d0503619-8f51-48e7-8fe2-18818d44273f service nova] Creating event network-changed:047b28e6-c7ee-4057-bd43-5589a50b5f51 for instance 32410ddb-881f-46f6-b3c6-67399fd5b53b on hv-cinder-80473 Jun 20 06:18:20.643042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-cf5fb1b3-4599-4d89-872b-09045d5480f8 req-d0503619-8f51-48e7-8fe2-18818d44273f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093339 Jun 20 06:18:20.644615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 328/641] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:21.280352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-107664021", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b38f118d-b9b9-4cf3-9e9d-8aa5b8ffa500"}], "security_groups": [{"name": "tempest-securitygroup--1050794658"}], "key_name": "tempest-keypair-287983682", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:21.333163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d8aa96a3-b94e-478f-92cc-b756923a259b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:21.333855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d8aa96a3-b94e-478f-92cc-b756923a259b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:21.358291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8aa96a3-b94e-478f-92cc-b756923a259b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:21.359452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8aa96a3-b94e-478f-92cc-b756923a259b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:21.363586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8aa96a3-b94e-478f-92cc-b756923a259b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:21.364120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8aa96a3-b94e-478f-92cc-b756923a259b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:21.417147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] validate_networks() for [('b38f118d-b9b9-4cf3-9e9d-8aa5b8ffa500', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:18:21.640233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d8aa96a3-b94e-478f-92cc-b756923a259b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:21.650239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d8aa96a3-b94e-478f-92cc-b756923a259b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.326494 Jun 20 06:18:21.651215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 329/642] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:21 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:21.929037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:18:21.929497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:18:21.930449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:18:21.930919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:18:21.932646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:18:21.941995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:21.942444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:21.943252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:21.943719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:21.961895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Getting quotas for project 8a2203406ec34776ab1a1e663601baaf. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:21.966812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Getting quotas for user 5fc0e8fe250349d699ea43aeee98170e and project 8a2203406ec34776ab1a1e663601baaf. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:21.978925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:18:21.981353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:18:22.031288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8c50fe9-de78-455b-84aa-d899ee1c7a42 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.756323 Jun 20 06:18:22.036740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 314/643] 10.222.0.16 () {62 vars in 1187 bytes} [Mon Jun 20 06:18:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 06:18:22.042367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-458c3087-46a3-43c6-8267-ff567411951c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:22.042980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-458c3087-46a3-43c6-8267-ff567411951c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:22.111211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-458c3087-46a3-43c6-8267-ff567411951c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:22.120615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-458c3087-46a3-43c6-8267-ff567411951c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:22.122216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-458c3087-46a3-43c6-8267-ff567411951c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:22.123380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-458c3087-46a3-43c6-8267-ff567411951c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1280 microversion: 2.20 time: 0.085365 Jun 20 06:18:22.123943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 330/644] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:22 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:22.669552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9369c26e-4ff1-4655-a0d9-2c266d304d3b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:22.670258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9369c26e-4ff1-4655-a0d9-2c266d304d3b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:22.679374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9369c26e-4ff1-4655-a0d9-2c266d304d3b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:22.679987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9369c26e-4ff1-4655-a0d9-2c266d304d3b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:22.681070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9369c26e-4ff1-4655-a0d9-2c266d304d3b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:22.682352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9369c26e-4ff1-4655-a0d9-2c266d304d3b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:22.838036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9369c26e-4ff1-4655-a0d9-2c266d304d3b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:22.850527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9369c26e-4ff1-4655-a0d9-2c266d304d3b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.186882 Jun 20 06:18:22.851117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 315/645] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:22 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:23.146245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:23.148103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:23.157535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:23.157991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:23.158770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:23.159210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:23.224075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:23.242305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:23.244309 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:23.245705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-052f53f0-bde3-4c85-8318-589bd80f627f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1340 microversion: 2.20 time: 0.107226 Jun 20 06:18:23.246915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 331/646] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:23 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:23.867471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7ac2fd8e-afa3-4032-a705-94cb5f8b971c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:23.868194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7ac2fd8e-afa3-4032-a705-94cb5f8b971c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:23.874797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ac2fd8e-afa3-4032-a705-94cb5f8b971c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:23.875318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ac2fd8e-afa3-4032-a705-94cb5f8b971c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:23.876148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ac2fd8e-afa3-4032-a705-94cb5f8b971c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:23.876584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ac2fd8e-afa3-4032-a705-94cb5f8b971c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:24.008473 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7ac2fd8e-afa3-4032-a705-94cb5f8b971c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:24.017207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7ac2fd8e-afa3-4032-a705-94cb5f8b971c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.153636 Jun 20 06:18:24.017811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 316/647] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:23 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:24.265075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:24.265766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:24.273945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:24.275535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:24.277051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:24.277702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:24.422669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:24.430640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:24.432348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:24.433489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4971cbff-e0f1-415d-9f14-6bf21cf10721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1406 microversion: 2.20 time: 0.172365 Jun 20 06:18:24.434063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 332/648] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:24 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:24.887658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-4e80078c-0922-4d73-bd26-db1b650ffbb6 req-b68f12b3-ae2a-46db-bf66-49fdaecf8d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf69dcc-0fce-409f-878a-a3ab64d3b0a0", "tag": "f742af21-fda3-4a74-b8b8-aa829f3bab03"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:24.897497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-4e80078c-0922-4d73-bd26-db1b650ffbb6 req-b68f12b3-ae2a-46db-bf66-49fdaecf8d24 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:24.898095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-4e80078c-0922-4d73-bd26-db1b650ffbb6 req-b68f12b3-ae2a-46db-bf66-49fdaecf8d24 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:24.919167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-4e80078c-0922-4d73-bd26-db1b650ffbb6 req-b68f12b3-ae2a-46db-bf66-49fdaecf8d24 service nova] Creating event network-changed:f742af21-fda3-4a74-b8b8-aa829f3bab03 for instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 on hv-cinder-80473 Jun 20 06:18:24.925497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-4e80078c-0922-4d73-bd26-db1b650ffbb6 req-b68f12b3-ae2a-46db-bf66-49fdaecf8d24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041411 Jun 20 06:18:24.926382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 317/649] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:25.035031 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fcb0a20a-f5cf-458a-9c2f-3fc42193e699 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:25.035646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fcb0a20a-f5cf-458a-9c2f-3fc42193e699 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:25.043008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcb0a20a-f5cf-458a-9c2f-3fc42193e699 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:25.043651 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcb0a20a-f5cf-458a-9c2f-3fc42193e699 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:25.044532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcb0a20a-f5cf-458a-9c2f-3fc42193e699 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:25.045021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcb0a20a-f5cf-458a-9c2f-3fc42193e699 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:25.182424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fcb0a20a-f5cf-458a-9c2f-3fc42193e699 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:25.189779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fcb0a20a-f5cf-458a-9c2f-3fc42193e699 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.158608 Jun 20 06:18:25.190344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 333/650] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:25 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:25.452560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:25.453260 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:25.459381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:25.459830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:25.460609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:25.461048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:25.597082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:25.605249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:25.606786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:25.607885 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d82e5d48-5d90-4899-a398-669a7882aea8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1406 microversion: 2.20 time: 0.159786 Jun 20 06:18:25.608441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 318/651] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:25 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:26.206699 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d7801ebc-aa97-42b8-ae6e-09b36515ff7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:26.207303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d7801ebc-aa97-42b8-ae6e-09b36515ff7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:26.214693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7801ebc-aa97-42b8-ae6e-09b36515ff7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:26.215136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7801ebc-aa97-42b8-ae6e-09b36515ff7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:26.215891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7801ebc-aa97-42b8-ae6e-09b36515ff7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:26.216318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7801ebc-aa97-42b8-ae6e-09b36515ff7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:26.311769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:26.352620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7801ebc-aa97-42b8-ae6e-09b36515ff7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:26.360042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d7801ebc-aa97-42b8-ae6e-09b36515ff7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.157125 Jun 20 06:18:26.360597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 334/652] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:26 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:26.625992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:26.626602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:26.633003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:26.633492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:26.634253 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:26.634691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:26.762739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:26.770767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:26.772254 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:26.773349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8acd13c5-e377-4a34-8aff-2cc6c23b5c7f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1406 microversion: 2.20 time: 0.151263 Jun 20 06:18:26.773920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 319/653] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:26 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:27.376837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-73e74952-ab30-4323-ae15-5591dc3432a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:27.377405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-73e74952-ab30-4323-ae15-5591dc3432a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:27.383928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73e74952-ab30-4323-ae15-5591dc3432a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:27.384384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73e74952-ab30-4323-ae15-5591dc3432a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:27.385986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73e74952-ab30-4323-ae15-5591dc3432a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:27.386423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73e74952-ab30-4323-ae15-5591dc3432a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:27.388941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:27.517351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-73e74952-ab30-4323-ae15-5591dc3432a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:27.525503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-73e74952-ab30-4323-ae15-5591dc3432a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.152220 Jun 20 06:18:27.526103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 335/654] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:27 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:27.792360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:27.792978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:27.799471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:27.799924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:27.800691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:27.801137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:27.937201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:27.945043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:27.946570 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:27.947708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-129bb39f-c36b-4c4d-b4d0-d4e551e3e1d7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1406 microversion: 2.20 time: 0.159862 Jun 20 06:18:27.948263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 320/655] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:27 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:28.541548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d6f43a34-31e1-45d9-ab9d-2cd3ab557885 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:28.542302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d6f43a34-31e1-45d9-ab9d-2cd3ab557885 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:28.548814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6f43a34-31e1-45d9-ab9d-2cd3ab557885 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:28.549257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6f43a34-31e1-45d9-ab9d-2cd3ab557885 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:28.550048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6f43a34-31e1-45d9-ab9d-2cd3ab557885 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:28.550481 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6f43a34-31e1-45d9-ab9d-2cd3ab557885 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:28.683308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d6f43a34-31e1-45d9-ab9d-2cd3ab557885 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:28.690851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d6f43a34-31e1-45d9-ab9d-2cd3ab557885 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.153708 Jun 20 06:18:28.691424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 336/656] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:28 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:28.966190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:28.966811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:28.973502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:28.973960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:28.974736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:28.975184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:28.980020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:29.116325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:29.125921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:29.127369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:29.128483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff3b23af-cb3e-450a-9c13-550ff42c25e3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1406 microversion: 2.20 time: 0.166926 Jun 20 06:18:29.139273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 321/657] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:28 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:29.708511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fe5f4cb8-d083-44bf-b141-a6fb906a2271 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:29.709256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fe5f4cb8-d083-44bf-b141-a6fb906a2271 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:29.716333 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe5f4cb8-d083-44bf-b141-a6fb906a2271 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:29.716782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe5f4cb8-d083-44bf-b141-a6fb906a2271 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:29.717574 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe5f4cb8-d083-44bf-b141-a6fb906a2271 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:29.718004 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe5f4cb8-d083-44bf-b141-a6fb906a2271 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:29.850804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fe5f4cb8-d083-44bf-b141-a6fb906a2271 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:29.859107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fe5f4cb8-d083-44bf-b141-a6fb906a2271 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.155625 Jun 20 06:18:29.859780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 337/658] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:29 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:30.147139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:30.147749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:30.154796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:30.155246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:30.156008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:30.156451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:30.288892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:30.297205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:30.298726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:30.299816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-17760c20-817f-458a-b428-6e57b3833109 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1406 microversion: 2.20 time: 0.156838 Jun 20 06:18:30.300373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 322/659] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:30 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:30.875148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-893b70d0-9594-468c-848e-484d7758cd91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:30.875688 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-893b70d0-9594-468c-848e-484d7758cd91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:30.882007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-893b70d0-9594-468c-848e-484d7758cd91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:30.882445 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-893b70d0-9594-468c-848e-484d7758cd91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:30.883192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-893b70d0-9594-468c-848e-484d7758cd91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:30.883617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-893b70d0-9594-468c-848e-484d7758cd91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:31.012371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-893b70d0-9594-468c-848e-484d7758cd91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:31.019998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-893b70d0-9594-468c-848e-484d7758cd91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.148767 Jun 20 06:18:31.020559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 338/660] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:30 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:31.318694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:31.319465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:31.326883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:31.327332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:31.328107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:31.328541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:31.431288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-33553208-486f-4090-a1be-d1fdf2d80b6d req-52d86b23-3f79-4410-85a7-e697a6a70b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf69dcc-0fce-409f-878a-a3ab64d3b0a0", "name": "network-vif-plugged", "status": "completed", "tag": "f742af21-fda3-4a74-b8b8-aa829f3bab03"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:31.442181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-33553208-486f-4090-a1be-d1fdf2d80b6d req-52d86b23-3f79-4410-85a7-e697a6a70b5f service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:31.442923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-33553208-486f-4090-a1be-d1fdf2d80b6d req-52d86b23-3f79-4410-85a7-e697a6a70b5f service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:31.455444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-33553208-486f-4090-a1be-d1fdf2d80b6d req-52d86b23-3f79-4410-85a7-e697a6a70b5f service nova] Creating event network-vif-plugged:f742af21-fda3-4a74-b8b8-aa829f3bab03 for instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 on hv-cinder-80473 Jun 20 06:18:31.460123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:31.460946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-33553208-486f-4090-a1be-d1fdf2d80b6d req-52d86b23-3f79-4410-85a7-e697a6a70b5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033731 Jun 20 06:18:31.461574 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 339/661] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:31.469254 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:31.470806 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:31.471967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-243f6a80-5ae0-4bbc-af76-468ae31d8978 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1406 microversion: 2.20 time: 0.157209 Jun 20 06:18:31.472493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 323/662] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:31 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:32.038441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d8cad372-889b-4341-8dcf-ecc16f620275 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:32.039159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d8cad372-889b-4341-8dcf-ecc16f620275 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:32.045963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8cad372-889b-4341-8dcf-ecc16f620275 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.046412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8cad372-889b-4341-8dcf-ecc16f620275 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.047168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8cad372-889b-4341-8dcf-ecc16f620275 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.047596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8cad372-889b-4341-8dcf-ecc16f620275 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.116319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=8 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:32.181011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d8cad372-889b-4341-8dcf-ecc16f620275 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:32.188947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d8cad372-889b-4341-8dcf-ecc16f620275 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.155226 Jun 20 06:18:32.189542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 340/663] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:32 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:32.490737 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:32.491345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:32.493280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:32.494567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=12 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:32.501551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.502002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.502762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.503213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.632149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:32.640165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:32.641680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:32.642770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1b92b9d9-52d4-46cc-a1b0-117209ce0cd2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1406 microversion: 2.20 time: 0.156103 Jun 20 06:18:32.643326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 324/664] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:32 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:33.205812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c46015fd-cece-4624-9e48-50612690c1a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:33.206417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c46015fd-cece-4624-9e48-50612690c1a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:33.212354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c46015fd-cece-4624-9e48-50612690c1a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.212796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c46015fd-cece-4624-9e48-50612690c1a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:33.214527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c46015fd-cece-4624-9e48-50612690c1a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.215005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c46015fd-cece-4624-9e48-50612690c1a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:33.347172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c46015fd-cece-4624-9e48-50612690c1a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:33.354622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c46015fd-cece-4624-9e48-50612690c1a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.152913 Jun 20 06:18:33.355171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 341/665] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:33 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:33.476966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-57fe6162-2c95-4eb9-a5e8-a0c93ff39b5c req-4f6c88a2-2b55-417f-aa78-444e454364f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32410ddb-881f-46f6-b3c6-67399fd5b53b", "name": "network-vif-plugged", "status": "completed", "tag": "047b28e6-c7ee-4057-bd43-5589a50b5f51"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:33.485024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-57fe6162-2c95-4eb9-a5e8-a0c93ff39b5c req-4f6c88a2-2b55-417f-aa78-444e454364f8 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.485502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-57fe6162-2c95-4eb9-a5e8-a0c93ff39b5c req-4f6c88a2-2b55-417f-aa78-444e454364f8 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:33.496770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-57fe6162-2c95-4eb9-a5e8-a0c93ff39b5c req-4f6c88a2-2b55-417f-aa78-444e454364f8 service nova] Creating event network-vif-plugged:047b28e6-c7ee-4057-bd43-5589a50b5f51 for instance 32410ddb-881f-46f6-b3c6-67399fd5b53b on hv-cinder-80473 Jun 20 06:18:33.501627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-57fe6162-2c95-4eb9-a5e8-a0c93ff39b5c req-4f6c88a2-2b55-417f-aa78-444e454364f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028353 Jun 20 06:18:33.502211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 325/666] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:33.661437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:33.662044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:33.669177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.669687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:33.670454 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.671508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:33.808204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:33.816226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:33.817750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:33.818906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6db05310-b0b7-4b3c-856e-4645d7de7bc1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1598 microversion: 2.20 time: 0.161474 Jun 20 06:18:33.819501 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 342/667] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:33 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:33.837408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5c6565ba-6cb9-4bce-9b2f-52ef3765e967 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:33.838566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5c6565ba-6cb9-4bce-9b2f-52ef3765e967 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:33.844728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c6565ba-6cb9-4bce-9b2f-52ef3765e967 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.845176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c6565ba-6cb9-4bce-9b2f-52ef3765e967 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:33.845971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c6565ba-6cb9-4bce-9b2f-52ef3765e967 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.846408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c6565ba-6cb9-4bce-9b2f-52ef3765e967 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:33.926411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5c6565ba-6cb9-4bce-9b2f-52ef3765e967 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093151 Jun 20 06:18:33.927104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 326/668] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Jun 20 06:18:33 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:18:34.371336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2c3960c0-9c9e-4b0f-a83b-f51b72d77003 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:34.371962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2c3960c0-9c9e-4b0f-a83b-f51b72d77003 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:34.378595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c3960c0-9c9e-4b0f-a83b-f51b72d77003 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:34.379039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c3960c0-9c9e-4b0f-a83b-f51b72d77003 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:34.379797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c3960c0-9c9e-4b0f-a83b-f51b72d77003 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:34.380218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c3960c0-9c9e-4b0f-a83b-f51b72d77003 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:34.520672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2c3960c0-9c9e-4b0f-a83b-f51b72d77003 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:34.528608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2c3960c0-9c9e-4b0f-a83b-f51b72d77003 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1265 microversion: 2.1 time: 0.161102 Jun 20 06:18:34.529174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 343/669] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:34 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:34.848430 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-a624e3a3-0cea-4e61-85d5-872b2eaf700d req-86fe555c-87bc-47b7-8a82-0e80d553737f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf69dcc-0fce-409f-878a-a3ab64d3b0a0", "tag": "f742af21-fda3-4a74-b8b8-aa829f3bab03"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:34.857602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a624e3a3-0cea-4e61-85d5-872b2eaf700d req-86fe555c-87bc-47b7-8a82-0e80d553737f service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:34.858045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a624e3a3-0cea-4e61-85d5-872b2eaf700d req-86fe555c-87bc-47b7-8a82-0e80d553737f service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:34.868723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-a624e3a3-0cea-4e61-85d5-872b2eaf700d req-86fe555c-87bc-47b7-8a82-0e80d553737f service nova] Creating event network-changed:f742af21-fda3-4a74-b8b8-aa829f3bab03 for instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 on hv-cinder-80473 Jun 20 06:18:34.874100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-a624e3a3-0cea-4e61-85d5-872b2eaf700d req-86fe555c-87bc-47b7-8a82-0e80d553737f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029650 Jun 20 06:18:34.875049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 327/670] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:35.545871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9b061f45-46b0-4786-8589-0d2be35fce21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:35.546506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9b061f45-46b0-4786-8589-0d2be35fce21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:35.552665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b061f45-46b0-4786-8589-0d2be35fce21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.553110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b061f45-46b0-4786-8589-0d2be35fce21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.553911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b061f45-46b0-4786-8589-0d2be35fce21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.554340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b061f45-46b0-4786-8589-0d2be35fce21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.697101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9b061f45-46b0-4786-8589-0d2be35fce21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:35.705812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9b061f45-46b0-4786-8589-0d2be35fce21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1452 microversion: 2.1 time: 0.164357 Jun 20 06:18:35.706398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 344/671] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:35 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:35.722438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24acfd71-f9c2-46a1-adb8-6fe505bdd3c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:35.723102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24acfd71-f9c2-46a1-adb8-6fe505bdd3c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:35.730094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24acfd71-f9c2-46a1-adb8-6fe505bdd3c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.731387 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24acfd71-f9c2-46a1-adb8-6fe505bdd3c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.732181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24acfd71-f9c2-46a1-adb8-6fe505bdd3c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.732626 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24acfd71-f9c2-46a1-adb8-6fe505bdd3c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.876336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24acfd71-f9c2-46a1-adb8-6fe505bdd3c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:35.886829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24acfd71-f9c2-46a1-adb8-6fe505bdd3c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1452 microversion: 2.1 time: 0.168598 Jun 20 06:18:35.890760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 328/672] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:35 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:37.707401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-33da42dc-d33f-4658-837c-25e3bec5a41e req-6b084306-42c7-46d2-a797-afe78d9f6188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32410ddb-881f-46f6-b3c6-67399fd5b53b", "tag": "047b28e6-c7ee-4057-bd43-5589a50b5f51"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:37.717092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-33da42dc-d33f-4658-837c-25e3bec5a41e req-6b084306-42c7-46d2-a797-afe78d9f6188 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:37.717566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-33da42dc-d33f-4658-837c-25e3bec5a41e req-6b084306-42c7-46d2-a797-afe78d9f6188 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:37.731368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-33da42dc-d33f-4658-837c-25e3bec5a41e req-6b084306-42c7-46d2-a797-afe78d9f6188 service nova] Creating event network-changed:047b28e6-c7ee-4057-bd43-5589a50b5f51 for instance 32410ddb-881f-46f6-b3c6-67399fd5b53b on hv-cinder-80473 Jun 20 06:18:37.736824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-33da42dc-d33f-4658-837c-25e3bec5a41e req-6b084306-42c7-46d2-a797-afe78d9f6188 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032887 Jun 20 06:18:37.737457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 345/673] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:03.187102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:03.187834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=37 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:03.297749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-65675de3-46af-41c8-a777-8142dedede99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:03.298250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-65675de3-46af-41c8-a777-8142dedede99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:03.304346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65675de3-46af-41c8-a777-8142dedede99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:03.304827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65675de3-46af-41c8-a777-8142dedede99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:03.305621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65675de3-46af-41c8-a777-8142dedede99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:03.306064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65675de3-46af-41c8-a777-8142dedede99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:03.330148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-65675de3-46af-41c8-a777-8142dedede99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/ips" status: 200 len: 150 microversion: 2.1 time: 0.147900 Jun 20 06:19:03.330718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 329/674] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:19:03 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/ips => generated 150 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:04.642922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9db4b9d5-2525-4ae6-b4d2-d1dd5a262428 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f682a051-b465-4d78-9089-d4afd85dc85d"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:04.644319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9db4b9d5-2525-4ae6-b4d2-d1dd5a262428 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:04.646546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=41 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:04.647177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=57 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:04.654324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9db4b9d5-2525-4ae6-b4d2-d1dd5a262428 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:04.654786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9db4b9d5-2525-4ae6-b4d2-d1dd5a262428 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:04.656299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9db4b9d5-2525-4ae6-b4d2-d1dd5a262428 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:04.656299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9db4b9d5-2525-4ae6-b4d2-d1dd5a262428 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:04.921077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9db4b9d5-2525-4ae6-b4d2-d1dd5a262428 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282391 Jun 20 06:19:04.921736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 346/675] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:19:04 2022] POST /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:12.434044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f682a051-b465-4d78-9089-d4afd85dc85d"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:12.435160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:12.445596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.447831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.450356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.450813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.532928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Invalid volume: volume f682a051-b465-4d78-9089-d4afd85dc85d is already attached to instances: f341d742-be1b-4305-96ef-cebe35a09f86 Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments HTTP/1.1 Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 74 Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:19:12.534683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {"volumeAttachment": {"volumeId": "f682a051-b465-4d78-9089-d4afd85dc85d"}} Jun 20 06:19:12.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Invalid volume: volume f682a051-b465-4d78-9089-d4afd85dc85d is already attached to instances: f341d742-be1b-4305-96ef-cebe35a09f86 Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'server_id': 'f341d742-be1b-4305-96ef-cebe35a09f86', 'body': {'volumeAttachment': {'volumeId': 'f682a051-b465-4d78-9089-d4afd85dc85d'}}} Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f682a051-b465-4d78-9089-d4afd85dc85d is already attached to instances: f341d742-be1b-4305-96ef-cebe35a09f86 Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:19:12.537182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f682a051-b465-4d78-9089-d4afd85dc85d is already attached to instances: f341d742-be1b-4305-96ef-cebe35a09f86 Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:12.538494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:12.540045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:12.540045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:19:12.540045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:19:12.540045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f682a051-b465-4d78-9089-d4afd85dc85d is already attached to instances: f341d742-be1b-4305-96ef-cebe35a09f86 Jun 20 06:19:12.540045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:19:12.540045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 400 to user: Invalid volume: volume f682a051-b465-4d78-9089-d4afd85dc85d is already attached to instances: f341d742-be1b-4305-96ef-cebe35a09f86 {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:19:12.540045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2341edb3-6b08-4501-bcf9-0685552723b7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106122 Jun 20 06:19:12.540045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 330/676] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:19:12 2022] POST /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:19:12.599217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fdcfbeae-6af8-45af-bfbd-e05731b07747 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:12.599850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fdcfbeae-6af8-45af-bfbd-e05731b07747 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:12.606390 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdcfbeae-6af8-45af-bfbd-e05731b07747 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.607272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdcfbeae-6af8-45af-bfbd-e05731b07747 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.608057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdcfbeae-6af8-45af-bfbd-e05731b07747 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.608497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdcfbeae-6af8-45af-bfbd-e05731b07747 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.688092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-fdcfbeae-6af8-45af-bfbd-e05731b07747 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lazy-loading 'services' on Instance uuid f341d742-be1b-4305-96ef-cebe35a09f86 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:12.762557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fdcfbeae-6af8-45af-bfbd-e05731b07747 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments/f682a051-b465-4d78-9089-d4afd85dc85d" status: 202 len: 0 microversion: 2.1 time: 0.167907 Jun 20 06:19:12.763149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 347/677] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:19:12 2022] DELETE /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments/f682a051-b465-4d78-9089-d4afd85dc85d => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:19:12.771846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-217a4368-c2d8-405e-a525-49a7af973688 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:12.772868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-217a4368-c2d8-405e-a525-49a7af973688 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:12.779976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-217a4368-c2d8-405e-a525-49a7af973688 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.780516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-217a4368-c2d8-405e-a525-49a7af973688 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.781424 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-217a4368-c2d8-405e-a525-49a7af973688 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.781990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-217a4368-c2d8-405e-a525-49a7af973688 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.812746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-217a4368-c2d8-405e-a525-49a7af973688 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Jun 20 06:19:12.813308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 331/678] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:12 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:13.825958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3067395e-8e7d-4291-a1f8-78660b17ed3f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:13.827030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3067395e-8e7d-4291-a1f8-78660b17ed3f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:13.833223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3067395e-8e7d-4291-a1f8-78660b17ed3f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:13.833710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3067395e-8e7d-4291-a1f8-78660b17ed3f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:13.834476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3067395e-8e7d-4291-a1f8-78660b17ed3f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:13.834911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3067395e-8e7d-4291-a1f8-78660b17ed3f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:13.863744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3067395e-8e7d-4291-a1f8-78660b17ed3f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043130 Jun 20 06:19:13.864210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 348/679] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:13 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:19:13.921250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-86a745d8-4d11-4676-b0b0-01eebd03fd62 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:13.921779 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-86a745d8-4d11-4676-b0b0-01eebd03fd62 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:13.928344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86a745d8-4d11-4676-b0b0-01eebd03fd62 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:13.928786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86a745d8-4d11-4676-b0b0-01eebd03fd62 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:13.929583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86a745d8-4d11-4676-b0b0-01eebd03fd62 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:13.930024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86a745d8-4d11-4676-b0b0-01eebd03fd62 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:13.956324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-86a745d8-4d11-4676-b0b0-01eebd03fd62 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:19:14.035508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-86a745d8-4d11-4676-b0b0-01eebd03fd62 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 204 len: 0 microversion: 2.1 time: 0.118031 Jun 20 06:19:14.036154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 332/680] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:19:13 2022] DELETE /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:19:14.044708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2cd888e9-cf0b-4b64-ae15-31fe58f5fec7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:14.045318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2cd888e9-cf0b-4b64-ae15-31fe58f5fec7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:14.051254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2cd888e9-cf0b-4b64-ae15-31fe58f5fec7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:14.051702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2cd888e9-cf0b-4b64-ae15-31fe58f5fec7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:14.052461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2cd888e9-cf0b-4b64-ae15-31fe58f5fec7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:14.052891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2cd888e9-cf0b-4b64-ae15-31fe58f5fec7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:14.189572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2cd888e9-cf0b-4b64-ae15-31fe58f5fec7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:14.196983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2cd888e9-cf0b-4b64-ae15-31fe58f5fec7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1681 microversion: 2.1 time: 0.156565 Jun 20 06:19:14.197572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 349/681] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:14 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:15.215687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e923814f-21e5-4c82-9632-fa81becd999b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:15.216425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e923814f-21e5-4c82-9632-fa81becd999b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:15.222626 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e923814f-21e5-4c82-9632-fa81becd999b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:15.223073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e923814f-21e5-4c82-9632-fa81becd999b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:15.223832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e923814f-21e5-4c82-9632-fa81becd999b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:15.224263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e923814f-21e5-4c82-9632-fa81becd999b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:15.364526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e923814f-21e5-4c82-9632-fa81becd999b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:15.372838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e923814f-21e5-4c82-9632-fa81becd999b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1681 microversion: 2.1 time: 0.161781 Jun 20 06:19:15.373432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 333/682] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:15 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:16.390276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c0321122-1b44-48fc-befc-b7f8c9d116c0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:16.390915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c0321122-1b44-48fc-befc-b7f8c9d116c0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:16.397908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0321122-1b44-48fc-befc-b7f8c9d116c0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:16.398423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0321122-1b44-48fc-befc-b7f8c9d116c0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:16.399190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0321122-1b44-48fc-befc-b7f8c9d116c0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:16.399618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0321122-1b44-48fc-befc-b7f8c9d116c0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:16.601777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c0321122-1b44-48fc-befc-b7f8c9d116c0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:16.615228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c0321122-1b44-48fc-befc-b7f8c9d116c0 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 200 len: 1681 microversion: 2.1 time: 0.229095 Jun 20 06:19:16.615964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 350/683] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:16 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:16.877593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8a13b2e2-6fc5-4ef8-9cc3-816969c1f50d req-ee7ccc41-f260-4507-a788-c7e1640ac2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f341d742-be1b-4305-96ef-cebe35a09f86", "name": "network-vif-deleted", "tag": "19241efd-327c-488f-b71f-e1053dad3a90"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:16.887052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8a13b2e2-6fc5-4ef8-9cc3-816969c1f50d req-ee7ccc41-f260-4507-a788-c7e1640ac2bd service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:16.887392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8a13b2e2-6fc5-4ef8-9cc3-816969c1f50d req-ee7ccc41-f260-4507-a788-c7e1640ac2bd service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:16.899667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8a13b2e2-6fc5-4ef8-9cc3-816969c1f50d req-ee7ccc41-f260-4507-a788-c7e1640ac2bd service nova] Creating event network-vif-deleted:19241efd-327c-488f-b71f-e1053dad3a90 for instance f341d742-be1b-4305-96ef-cebe35a09f86 on hv-cinder-80473 Jun 20 06:19:16.905774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8a13b2e2-6fc5-4ef8-9cc3-816969c1f50d req-ee7ccc41-f260-4507-a788-c7e1640ac2bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031840 Jun 20 06:19:16.906854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 334/684] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:17.634408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:17.635334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:17.644166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:17.644685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:17.645708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:17.646273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:17.663085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 HTTP/1.1 Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:19:17.665052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:19:17.666654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'f341d742-be1b-4305-96ef-cebe35a09f86'} Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:19:17.667525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:19:17.668789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:19:17.670195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:19:17.670195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cecdcaf4-6c1f-4676-8ee1-09888e8608ab tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 404 len: 111 microversion: 2.1 time: 0.036950 Jun 20 06:19:17.670195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 351/685] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:17 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:19:17.677515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-892e86ae-15ca-4cf7-834a-268eb765c42b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '.version_select at 0x7f7a7a740ca0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:17.697045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-892e86ae-15ca-4cf7-834a-268eb765c42b tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702014343" status: 202 len: 0 microversion: 2.1 time: 0.024363 Jun 20 06:19:17.697785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 335/686] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jun 20 06:19:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702014343 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:19:18.353091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-70c95994-20cf-4991-b34f-24c7de64e088 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: .version_select at 0x7f7a7a57ce50>, body: {"keypair": {"name": "tempest-keypair-1200320437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKZLM+37beKkcNdRNNwVoGu9qL2x4ttCaYATHwOulUEgH/VZBlx7Ys8f3Y3g/Qxrq8GFFq1UNK4ee92+3DrH5KK5rRLMjXHE24TtsL9U1aur2//TI/ZHJiyXmMv7wlBuQ=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:18.367199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-70c95994-20cf-4991-b34f-24c7de64e088 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for project fde00bac11024d898d6d87b8d2abc29e. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:19:18.370999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-70c95994-20cf-4991-b34f-24c7de64e088 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for user ee7405c2b1504907ba919e2797e63754 and project fde00bac11024d898d6d87b8d2abc29e. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:19:18.393428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-70c95994-20cf-4991-b34f-24c7de64e088 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044178 Jun 20 06:19:18.394289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 352/687] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:19:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:19.669151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-759061183", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9962bf9-afc3-4bca-900b-7a55dc02f894"}], "security_groups": [{"name": "tempest-securitygroup--202035177"}], "key_name": "tempest-keypair-1200320437", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:19.777879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] validate_networks() for [('e9962bf9-afc3-4bca-900b-7a55dc02f894', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:19:20.151459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:19:20.151966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:19:20.152645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:19:20.153262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:19:20.153789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:19:20.163813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:20.164270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:20.165141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:20.165606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:20.182891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for project fde00bac11024d898d6d87b8d2abc29e. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:19:20.187582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Getting quotas for user ee7405c2b1504907ba919e2797e63754 and project fde00bac11024d898d6d87b8d2abc29e. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:19:20.198500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:19:20.200884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:19:20.249762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f3faea53-6d9b-4bec-9d31-ae5ab7dc527a tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.585336 Jun 20 06:19:20.250415 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 336/688] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:19:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:19:20.260783 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-14bdd5c4-315e-4f7c-93c8-8acef5bd5eb9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:20.261428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-14bdd5c4-315e-4f7c-93c8-8acef5bd5eb9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:20.318978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-14bdd5c4-315e-4f7c-93c8-8acef5bd5eb9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:20.327362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-14bdd5c4-315e-4f7c-93c8-8acef5bd5eb9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1241 microversion: 2.1 time: 0.070814 Jun 20 06:19:20.333510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 353/689] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:20 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:21.348514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-237769ba-4a00-4d81-9412-ac38fa8afe04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:21.351165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-237769ba-4a00-4d81-9412-ac38fa8afe04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:21.360348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-237769ba-4a00-4d81-9412-ac38fa8afe04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:21.361982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-237769ba-4a00-4d81-9412-ac38fa8afe04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:21.363128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-237769ba-4a00-4d81-9412-ac38fa8afe04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:21.363934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-237769ba-4a00-4d81-9412-ac38fa8afe04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:21.443970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-237769ba-4a00-4d81-9412-ac38fa8afe04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:21.451722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-237769ba-4a00-4d81-9412-ac38fa8afe04 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1301 microversion: 2.1 time: 0.108595 Jun 20 06:19:21.452450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 337/690] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:21 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:22.468138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-934f197e-5d97-4e75-97a6-ef84f7970040 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:22.468912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-934f197e-5d97-4e75-97a6-ef84f7970040 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:22.475538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-934f197e-5d97-4e75-97a6-ef84f7970040 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:22.475995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-934f197e-5d97-4e75-97a6-ef84f7970040 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:22.476769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-934f197e-5d97-4e75-97a6-ef84f7970040 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:22.477219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-934f197e-5d97-4e75-97a6-ef84f7970040 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:22.715770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-934f197e-5d97-4e75-97a6-ef84f7970040 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:22.724038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-934f197e-5d97-4e75-97a6-ef84f7970040 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1366 microversion: 2.1 time: 0.259717 Jun 20 06:19:22.724623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 354/691] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:22 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:22.868451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-d2b7ceb9-c5f4-430c-b6d7-94d4a925841b req-f69942f9-0bcb-4c33-ae7f-a0539f986417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db26865-a90b-41a0-9a7a-75e98e68eded", "tag": "d6e94c11-8472-406c-9fc8-764818ed527c"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:22.879397 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d2b7ceb9-c5f4-430c-b6d7-94d4a925841b req-f69942f9-0bcb-4c33-ae7f-a0539f986417 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:22.879814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d2b7ceb9-c5f4-430c-b6d7-94d4a925841b req-f69942f9-0bcb-4c33-ae7f-a0539f986417 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:22.893900 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-d2b7ceb9-c5f4-430c-b6d7-94d4a925841b req-f69942f9-0bcb-4c33-ae7f-a0539f986417 service nova] Creating event network-changed:d6e94c11-8472-406c-9fc8-764818ed527c for instance 0db26865-a90b-41a0-9a7a-75e98e68eded on hv-cinder-80473 Jun 20 06:19:22.899903 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-d2b7ceb9-c5f4-430c-b6d7-94d4a925841b req-f69942f9-0bcb-4c33-ae7f-a0539f986417 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034971 Jun 20 06:19:22.900534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 338/692] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:23.742269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4ad13f38-601b-4dfb-b027-4d6f0b28d104 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:23.742876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4ad13f38-601b-4dfb-b027-4d6f0b28d104 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:23.749570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4ad13f38-601b-4dfb-b027-4d6f0b28d104 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:23.750021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4ad13f38-601b-4dfb-b027-4d6f0b28d104 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:23.750802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4ad13f38-601b-4dfb-b027-4d6f0b28d104 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:23.751242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4ad13f38-601b-4dfb-b027-4d6f0b28d104 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:23.946390 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4ad13f38-601b-4dfb-b027-4d6f0b28d104 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:23.957182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4ad13f38-601b-4dfb-b027-4d6f0b28d104 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1366 microversion: 2.1 time: 0.218445 Jun 20 06:19:23.958169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 355/693] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:23 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:24.979152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-453f9e28-c681-43cf-9afa-6e38f2f1f9c2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:24.979923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-453f9e28-c681-43cf-9afa-6e38f2f1f9c2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:24.987169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-453f9e28-c681-43cf-9afa-6e38f2f1f9c2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.987625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-453f9e28-c681-43cf-9afa-6e38f2f1f9c2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.988395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-453f9e28-c681-43cf-9afa-6e38f2f1f9c2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.988835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-453f9e28-c681-43cf-9afa-6e38f2f1f9c2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:25.118298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-453f9e28-c681-43cf-9afa-6e38f2f1f9c2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:25.126287 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-453f9e28-c681-43cf-9afa-6e38f2f1f9c2 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1366 microversion: 2.1 time: 0.151936 Jun 20 06:19:25.126845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 339/694] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:24 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:26.143618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-851d8151-84c6-4c27-b2d7-12c18ca0a2a6 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:26.144508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-851d8151-84c6-4c27-b2d7-12c18ca0a2a6 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:26.150974 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-851d8151-84c6-4c27-b2d7-12c18ca0a2a6 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:26.151419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-851d8151-84c6-4c27-b2d7-12c18ca0a2a6 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:26.152820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-851d8151-84c6-4c27-b2d7-12c18ca0a2a6 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:26.153258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-851d8151-84c6-4c27-b2d7-12c18ca0a2a6 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:26.286731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-851d8151-84c6-4c27-b2d7-12c18ca0a2a6 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:26.294424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-851d8151-84c6-4c27-b2d7-12c18ca0a2a6 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1366 microversion: 2.1 time: 0.154634 Jun 20 06:19:26.294987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 356/695] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:26 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:27.311921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b9e09542-57e2-465d-8c9f-2583eebe99fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:27.312477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b9e09542-57e2-465d-8c9f-2583eebe99fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:27.319108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9e09542-57e2-465d-8c9f-2583eebe99fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:27.319553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9e09542-57e2-465d-8c9f-2583eebe99fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:27.320320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9e09542-57e2-465d-8c9f-2583eebe99fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:27.320749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9e09542-57e2-465d-8c9f-2583eebe99fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:27.456910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b9e09542-57e2-465d-8c9f-2583eebe99fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:27.465049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b9e09542-57e2-465d-8c9f-2583eebe99fa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1366 microversion: 2.1 time: 0.157086 Jun 20 06:19:27.465681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 340/696] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:27 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:28.482447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4c8e2b1e-23dc-4cd8-8470-49e3e5829adb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:28.483026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4c8e2b1e-23dc-4cd8-8470-49e3e5829adb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:28.489906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c8e2b1e-23dc-4cd8-8470-49e3e5829adb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:28.490526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c8e2b1e-23dc-4cd8-8470-49e3e5829adb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:28.491346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c8e2b1e-23dc-4cd8-8470-49e3e5829adb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:28.491810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c8e2b1e-23dc-4cd8-8470-49e3e5829adb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:28.620420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4c8e2b1e-23dc-4cd8-8470-49e3e5829adb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:28.628014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4c8e2b1e-23dc-4cd8-8470-49e3e5829adb tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1366 microversion: 2.1 time: 0.149487 Jun 20 06:19:28.628567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 357/697] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:28 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:29.556383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-dfc3863d-2e1f-401d-aefb-d661a8fc4aa2 req-df2e2810-c955-4fcf-b1f1-a0cea6e1549d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db26865-a90b-41a0-9a7a-75e98e68eded", "name": "network-vif-plugged", "status": "completed", "tag": "d6e94c11-8472-406c-9fc8-764818ed527c"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:29.567086 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-dfc3863d-2e1f-401d-aefb-d661a8fc4aa2 req-df2e2810-c955-4fcf-b1f1-a0cea6e1549d service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.567541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-dfc3863d-2e1f-401d-aefb-d661a8fc4aa2 req-df2e2810-c955-4fcf-b1f1-a0cea6e1549d service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.579872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-dfc3863d-2e1f-401d-aefb-d661a8fc4aa2 req-df2e2810-c955-4fcf-b1f1-a0cea6e1549d service nova] Creating event network-vif-plugged:d6e94c11-8472-406c-9fc8-764818ed527c for instance 0db26865-a90b-41a0-9a7a-75e98e68eded on hv-cinder-80473 Jun 20 06:19:29.584645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-dfc3863d-2e1f-401d-aefb-d661a8fc4aa2 req-df2e2810-c955-4fcf-b1f1-a0cea6e1549d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032356 Jun 20 06:19:29.585245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 341/698] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:29.646037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-65989229-9768-448e-8913-a417ebeb830c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:29.646828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-65989229-9768-448e-8913-a417ebeb830c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:29.654177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65989229-9768-448e-8913-a417ebeb830c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.654639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65989229-9768-448e-8913-a417ebeb830c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.655421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65989229-9768-448e-8913-a417ebeb830c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.655860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65989229-9768-448e-8913-a417ebeb830c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.813206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-65989229-9768-448e-8913-a417ebeb830c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:29.820961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-65989229-9768-448e-8913-a417ebeb830c tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1366 microversion: 2.1 time: 0.179295 Jun 20 06:19:29.821549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 358/699] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:29 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:30.835485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:30.836235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:30.841535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-abd6eb93-6a59-48a4-a82f-3a58f0163673 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:30.842170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-abd6eb93-6a59-48a4-a82f-3a58f0163673 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:30.849195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abd6eb93-6a59-48a4-a82f-3a58f0163673 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:30.849662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abd6eb93-6a59-48a4-a82f-3a58f0163673 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:30.850453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abd6eb93-6a59-48a4-a82f-3a58f0163673 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:30.850888 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abd6eb93-6a59-48a4-a82f-3a58f0163673 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:30.983552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-abd6eb93-6a59-48a4-a82f-3a58f0163673 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:30.991373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-abd6eb93-6a59-48a4-a82f-3a58f0163673 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1366 microversion: 2.1 time: 0.156802 Jun 20 06:19:30.991944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 342/700] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:30 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:32.007994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-513f0589-ef94-406e-9592-900887c628aa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:32.008552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-513f0589-ef94-406e-9592-900887c628aa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:32.010468 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:32.017139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-513f0589-ef94-406e-9592-900887c628aa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.017636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-513f0589-ef94-406e-9592-900887c628aa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:32.018405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-513f0589-ef94-406e-9592-900887c628aa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.019110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-513f0589-ef94-406e-9592-900887c628aa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:32.148414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-513f0589-ef94-406e-9592-900887c628aa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:32.156937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-513f0589-ef94-406e-9592-900887c628aa tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1557 microversion: 2.1 time: 0.152822 Jun 20 06:19:32.157568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 359/701] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:32 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:32.174115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-effc8750-7e54-481e-acc0-35eb4350f48e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:32.174645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-effc8750-7e54-481e-acc0-35eb4350f48e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:32.181059 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-effc8750-7e54-481e-acc0-35eb4350f48e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.181543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-effc8750-7e54-481e-acc0-35eb4350f48e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:32.182303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-effc8750-7e54-481e-acc0-35eb4350f48e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.182735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-effc8750-7e54-481e-acc0-35eb4350f48e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:32.259515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-effc8750-7e54-481e-acc0-35eb4350f48e tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089405 Jun 20 06:19:32.260051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 343/702] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jun 20 06:19:32 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:33.195426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-948bd155-a42e-4987-8874-a5188d5fd40f req-b6a3646a-a2de-415e-955f-baf407577000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db26865-a90b-41a0-9a7a-75e98e68eded", "tag": "d6e94c11-8472-406c-9fc8-764818ed527c"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:33.204800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-948bd155-a42e-4987-8874-a5188d5fd40f req-b6a3646a-a2de-415e-955f-baf407577000 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:33.205244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-948bd155-a42e-4987-8874-a5188d5fd40f req-b6a3646a-a2de-415e-955f-baf407577000 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:33.217235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-948bd155-a42e-4987-8874-a5188d5fd40f req-b6a3646a-a2de-415e-955f-baf407577000 service nova] Creating event network-changed:d6e94c11-8472-406c-9fc8-764818ed527c for instance 0db26865-a90b-41a0-9a7a-75e98e68eded on hv-cinder-80473 Jun 20 06:19:33.222494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-948bd155-a42e-4987-8874-a5188d5fd40f req-b6a3646a-a2de-415e-955f-baf407577000 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030676 Jun 20 06:19:33.223030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 360/703] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:34.517677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5351c2d5-fc36-4dba-910b-c486c0a77c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:34.518236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5351c2d5-fc36-4dba-910b-c486c0a77c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:34.520269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:34.525517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5351c2d5-fc36-4dba-910b-c486c0a77c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.525975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5351c2d5-fc36-4dba-910b-c486c0a77c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.526747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5351c2d5-fc36-4dba-910b-c486c0a77c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.527826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5351c2d5-fc36-4dba-910b-c486c0a77c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.531018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:34.554981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5351c2d5-fc36-4dba-910b-c486c0a77c86 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/ips" status: 200 len: 147 microversion: 2.1 time: 0.041737 Jun 20 06:19:34.555561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 344/704] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:19:34 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:35.880053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bd7fb1e7-05f6-4624-aab6-329375ee99e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "042aaff7-a7ef-4497-81b8-f0be932336f0"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:35.881198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bd7fb1e7-05f6-4624-aab6-329375ee99e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:35.883529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:35.889098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd7fb1e7-05f6-4624-aab6-329375ee99e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:35.889585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd7fb1e7-05f6-4624-aab6-329375ee99e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:35.890353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd7fb1e7-05f6-4624-aab6-329375ee99e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:35.890791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd7fb1e7-05f6-4624-aab6-329375ee99e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:35.895558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:36.157052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bd7fb1e7-05f6-4624-aab6-329375ee99e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281407 Jun 20 06:19:36.157939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 361/705] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:19:35 2022] POST /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:43.655921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bff8cf75-28ab-482e-a1d1-c7e9fb4386d6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:43.656849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bff8cf75-28ab-482e-a1d1-c7e9fb4386d6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:43.663663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bff8cf75-28ab-482e-a1d1-c7e9fb4386d6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:43.664122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bff8cf75-28ab-482e-a1d1-c7e9fb4386d6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:43.664893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bff8cf75-28ab-482e-a1d1-c7e9fb4386d6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:43.665337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bff8cf75-28ab-482e-a1d1-c7e9fb4386d6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:43.696733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bff8cf75-28ab-482e-a1d1-c7e9fb4386d6 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Jun 20 06:19:43.697296 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 345/706] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:43 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:43.708214 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e4f44e53-9241-44cc-b94b-0eee3527bde2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:43.708787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e4f44e53-9241-44cc-b94b-0eee3527bde2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:43.715915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f44e53-9241-44cc-b94b-0eee3527bde2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:43.716361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f44e53-9241-44cc-b94b-0eee3527bde2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:43.717109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f44e53-9241-44cc-b94b-0eee3527bde2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:43.717566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f44e53-9241-44cc-b94b-0eee3527bde2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:43.745747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e4f44e53-9241-44cc-b94b-0eee3527bde2 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/042aaff7-a7ef-4497-81b8-f0be932336f0" status: 200 len: 194 microversion: 2.1 time: 0.042299 Jun 20 06:19:43.746318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 362/707] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Jun 20 06:19:43 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/042aaff7-a7ef-4497-81b8-f0be932336f0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:45.088514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-223a7531-4ba6-4c47-9967-1ccf250e2c5c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c02530a-824f-46b4-8862-08ce7727410a"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:45.090196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-223a7531-4ba6-4c47-9967-1ccf250e2c5c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:45.096210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-223a7531-4ba6-4c47-9967-1ccf250e2c5c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:45.096660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-223a7531-4ba6-4c47-9967-1ccf250e2c5c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:45.097446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-223a7531-4ba6-4c47-9967-1ccf250e2c5c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:45.097884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-223a7531-4ba6-4c47-9967-1ccf250e2c5c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:45.361658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-223a7531-4ba6-4c47-9967-1ccf250e2c5c tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "POST /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277029 Jun 20 06:19:45.363002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 346/708] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:19:45 2022] POST /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:52.853161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3de1c492-f464-4817-98b3-2e56598f5c1b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:52.854171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3de1c492-f464-4817-98b3-2e56598f5c1b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:52.861761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3de1c492-f464-4817-98b3-2e56598f5c1b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:52.862210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3de1c492-f464-4817-98b3-2e56598f5c1b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:52.862977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3de1c492-f464-4817-98b3-2e56598f5c1b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:52.863409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3de1c492-f464-4817-98b3-2e56598f5c1b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:52.892692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3de1c492-f464-4817-98b3-2e56598f5c1b tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043366 Jun 20 06:19:52.893238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 363/709] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:52 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:53.032206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3c0c1b3d-ab10-4b9f-a269-5abb74488082 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:53.032745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3c0c1b3d-ab10-4b9f-a269-5abb74488082 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:53.039322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c0c1b3d-ab10-4b9f-a269-5abb74488082 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.039767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c0c1b3d-ab10-4b9f-a269-5abb74488082 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.040521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c0c1b3d-ab10-4b9f-a269-5abb74488082 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.040951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c0c1b3d-ab10-4b9f-a269-5abb74488082 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.070331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3c0c1b3d-ab10-4b9f-a269-5abb74488082 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/042aaff7-a7ef-4497-81b8-f0be932336f0" status: 200 len: 194 microversion: 2.1 time: 0.042513 Jun 20 06:19:53.070910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 347/710] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Jun 20 06:19:53 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/042aaff7-a7ef-4497-81b8-f0be932336f0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:53.079673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b33be651-910e-4ee8-a65b-cc089d878987 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:53.080156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b33be651-910e-4ee8-a65b-cc089d878987 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:53.080801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a59c43e-5609-495c-93a7-8b2a0580d002 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:53.081343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a59c43e-5609-495c-93a7-8b2a0580d002 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:53.086334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b33be651-910e-4ee8-a65b-cc089d878987 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.086776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b33be651-910e-4ee8-a65b-cc089d878987 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.087352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a59c43e-5609-495c-93a7-8b2a0580d002 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.087531 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b33be651-910e-4ee8-a65b-cc089d878987 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.087811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a59c43e-5609-495c-93a7-8b2a0580d002 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.087960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b33be651-910e-4ee8-a65b-cc089d878987 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.088581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a59c43e-5609-495c-93a7-8b2a0580d002 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.089024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a59c43e-5609-495c-93a7-8b2a0580d002 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.111899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b33be651-910e-4ee8-a65b-cc089d878987 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/ips" status: 200 len: 151 microversion: 2.20 time: 0.036223 Jun 20 06:19:53.112656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 364/711] 10.222.0.16 () {60 vars in 1288 bytes} [Mon Jun 20 06:19:53 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:19:53.171920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-2a59c43e-5609-495c-93a7-8b2a0580d002 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lazy-loading 'services' on Instance uuid 36614b0c-286e-453d-86f6-88d8150ff347 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:53.286827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a59c43e-5609-495c-93a7-8b2a0580d002 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/042aaff7-a7ef-4497-81b8-f0be932336f0" status: 202 len: 0 microversion: 2.1 time: 0.209586 Jun 20 06:19:53.287421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 348/712] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:19:53 2022] DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/042aaff7-a7ef-4497-81b8-f0be932336f0 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:19:55.365145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eabd428e-310d-4e7d-aa5d-27df11f18e19 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:55.365734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eabd428e-310d-4e7d-aa5d-27df11f18e19 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:55.373699 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eabd428e-310d-4e7d-aa5d-27df11f18e19 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.374154 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eabd428e-310d-4e7d-aa5d-27df11f18e19 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.374919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eabd428e-310d-4e7d-aa5d-27df11f18e19 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.375361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eabd428e-310d-4e7d-aa5d-27df11f18e19 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.397861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-eabd428e-310d-4e7d-aa5d-27df11f18e19 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lazy-loading 'flavor' on Instance uuid bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:55.471732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a5680f29-6fef-4f98-bf53-fd098d6dbf51 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:55.472299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a5680f29-6fef-4f98-bf53-fd098d6dbf51 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:55.481151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5680f29-6fef-4f98-bf53-fd098d6dbf51 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.481151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5680f29-6fef-4f98-bf53-fd098d6dbf51 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.481151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5680f29-6fef-4f98-bf53-fd098d6dbf51 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.481428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5680f29-6fef-4f98-bf53-fd098d6dbf51 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.510343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a5680f29-6fef-4f98-bf53-fd098d6dbf51 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/2c02530a-824f-46b4-8862-08ce7727410a" status: 200 len: 194 microversion: 2.1 time: 0.042805 Jun 20 06:19:55.511584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 349/713] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Jun 20 06:19:55 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/2c02530a-824f-46b4-8862-08ce7727410a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:55.521424 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-42693ba5-0b2e-421d-a4c4-6ff738195c4e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:55.521849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-42693ba5-0b2e-421d-a4c4-6ff738195c4e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:55.529058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42693ba5-0b2e-421d-a4c4-6ff738195c4e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.529560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42693ba5-0b2e-421d-a4c4-6ff738195c4e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.530326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42693ba5-0b2e-421d-a4c4-6ff738195c4e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.530770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42693ba5-0b2e-421d-a4c4-6ff738195c4e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.613655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-42693ba5-0b2e-421d-a4c4-6ff738195c4e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lazy-loading 'services' on Instance uuid 36614b0c-286e-453d-86f6-88d8150ff347 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:55.664703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eabd428e-310d-4e7d-aa5d-27df11f18e19 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "POST /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/action" status: 202 len: 0 microversion: 2.20 time: 0.303312 Jun 20 06:19:55.665328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 365/714] 10.222.0.16 () {62 vars in 1318 bytes} [Mon Jun 20 06:19:55 2022] POST /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:19:55.674299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:55.675023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:55.681690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.682234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.683609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.684055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.694966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-42693ba5-0b2e-421d-a4c4-6ff738195c4e tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/2c02530a-824f-46b4-8862-08ce7727410a" status: 202 len: 0 microversion: 2.1 time: 0.177536 Jun 20 06:19:55.695593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 350/715] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:19:55 2022] DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments/2c02530a-824f-46b4-8862-08ce7727410a => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:19:55.831178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:55.839397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:55.840909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:55.842098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5d221f6c-c5b9-4469-9a68-9dea651e1bd5 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.172189 Jun 20 06:19:55.842667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 366/716] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:19:55 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:19:56.862033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:56.862736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:56.869947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:56.870402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:56.871751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:56.872200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:57.005029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:57.013670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:57.015183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:57.016408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-60886f0b-e8f9-45a9-af3c-91a3f97f91cc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.159163 Jun 20 06:19:57.016908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 351/717] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:19:56 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:19:57.919498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-13f4cb69-86a3-4ff0-96be-4372b4597586 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:57.920478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-13f4cb69-86a3-4ff0-96be-4372b4597586 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:57.926960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13f4cb69-86a3-4ff0-96be-4372b4597586 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:57.927413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13f4cb69-86a3-4ff0-96be-4372b4597586 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:57.928184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13f4cb69-86a3-4ff0-96be-4372b4597586 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:57.928622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13f4cb69-86a3-4ff0-96be-4372b4597586 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:57.957545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-13f4cb69-86a3-4ff0-96be-4372b4597586 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042425 Jun 20 06:19:57.958096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 367/718] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:57 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:19:58.037736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:58.038437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:58.045633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:58.046099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:58.047075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:58.047520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:58.074802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-811349aa-9082-4627-a138-24070918b185 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:58.075683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-811349aa-9082-4627-a138-24070918b185 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:58.082589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-811349aa-9082-4627-a138-24070918b185 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:58.083112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-811349aa-9082-4627-a138-24070918b185 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:58.084003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-811349aa-9082-4627-a138-24070918b185 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:58.084524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-811349aa-9082-4627-a138-24070918b185 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:58.114541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-811349aa-9082-4627-a138-24070918b185 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045143 Jun 20 06:19:58.115399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 368/719] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:58 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:19:58.173213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bf2694f1-64bc-452b-b3d1-73e8136b71c1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:58.173746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bf2694f1-64bc-452b-b3d1-73e8136b71c1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:58.180748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf2694f1-64bc-452b-b3d1-73e8136b71c1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:58.181305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf2694f1-64bc-452b-b3d1-73e8136b71c1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:58.182177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf2694f1-64bc-452b-b3d1-73e8136b71c1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:58.183009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:58.183565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf2694f1-64bc-452b-b3d1-73e8136b71c1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:58.191035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:58.192518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:58.193745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6f213f29-ca8e-4886-8e94-1013d135f96c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.159757 Jun 20 06:19:58.194291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 352/720] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:19:58 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:19:58.213793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bf2694f1-64bc-452b-b3d1-73e8136b71c1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:19:58.291065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bf2694f1-64bc-452b-b3d1-73e8136b71c1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 204 len: 0 microversion: 2.1 time: 0.121373 Jun 20 06:19:58.292427 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 369/721] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:19:58 2022] DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:19:58.300783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-54fe658c-ed68-4107-b335-5b2ad051c470 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:58.301423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54fe658c-ed68-4107-b335-5b2ad051c470 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:58.308070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54fe658c-ed68-4107-b335-5b2ad051c470 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:58.308563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54fe658c-ed68-4107-b335-5b2ad051c470 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:58.309657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54fe658c-ed68-4107-b335-5b2ad051c470 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:58.310105 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54fe658c-ed68-4107-b335-5b2ad051c470 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:58.445135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-54fe658c-ed68-4107-b335-5b2ad051c470 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:58.452644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-54fe658c-ed68-4107-b335-5b2ad051c470 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1674 microversion: 2.1 time: 0.155886 Jun 20 06:19:58.453206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 353/722] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:58 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:59.215157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:59.215933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:59.223443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:59.223960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:59.224851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:59.225354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:59.363182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:59.371121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:59.372624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:59.373819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a321251-c9c5-4198-bca7-59cbac11eccf tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.163954 Jun 20 06:19:59.374375 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 370/723] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:19:59 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:19:59.470463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-168bb298-38e8-43aa-8edc-df3d773aeac9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:59.471101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-168bb298-38e8-43aa-8edc-df3d773aeac9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:59.477634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-168bb298-38e8-43aa-8edc-df3d773aeac9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:59.478083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-168bb298-38e8-43aa-8edc-df3d773aeac9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:59.478852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-168bb298-38e8-43aa-8edc-df3d773aeac9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:59.479307 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-168bb298-38e8-43aa-8edc-df3d773aeac9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:59.612070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-168bb298-38e8-43aa-8edc-df3d773aeac9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:59.619594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-168bb298-38e8-43aa-8edc-df3d773aeac9 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1674 microversion: 2.1 time: 0.153458 Jun 20 06:19:59.621353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 354/724] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:59 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:00.391976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:00.392576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:00.399258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:00.399683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:00.400440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:00.400868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:00.533746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:00.542261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:00.543764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:00.544908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-df05b56f-f4cb-4702-a971-ea96a21b307e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.156846 Jun 20 06:20:00.545470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 371/725] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:00 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:00.637794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-adbc4d5c-e3a3-40b1-89a2-f3ebaed3eaa1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:00.638453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-adbc4d5c-e3a3-40b1-89a2-f3ebaed3eaa1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:00.645178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adbc4d5c-e3a3-40b1-89a2-f3ebaed3eaa1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:00.645655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adbc4d5c-e3a3-40b1-89a2-f3ebaed3eaa1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:00.646419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adbc4d5c-e3a3-40b1-89a2-f3ebaed3eaa1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:00.646857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adbc4d5c-e3a3-40b1-89a2-f3ebaed3eaa1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:00.847739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-adbc4d5c-e3a3-40b1-89a2-f3ebaed3eaa1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:00.855892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-adbc4d5c-e3a3-40b1-89a2-f3ebaed3eaa1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1674 microversion: 2.1 time: 0.221918 Jun 20 06:20:00.856479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 355/726] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:00 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:01.563744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:01.565057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:01.571856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:01.572498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:01.573334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:01.573798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:01.610602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-c4b73ece-83d6-4a08-8caa-b04be9f8491e req-14df11c7-db72-42bc-a69f-d040d8dab7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36614b0c-286e-453d-86f6-88d8150ff347", "name": "network-vif-deleted", "tag": "5a3ee1e2-f316-4cb3-a668-cca2f797fceb"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:01.622360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c4b73ece-83d6-4a08-8caa-b04be9f8491e req-14df11c7-db72-42bc-a69f-d040d8dab7d6 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:01.622984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c4b73ece-83d6-4a08-8caa-b04be9f8491e req-14df11c7-db72-42bc-a69f-d040d8dab7d6 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:01.635823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-c4b73ece-83d6-4a08-8caa-b04be9f8491e req-14df11c7-db72-42bc-a69f-d040d8dab7d6 service nova] Creating event network-vif-deleted:5a3ee1e2-f316-4cb3-a668-cca2f797fceb for instance 36614b0c-286e-453d-86f6-88d8150ff347 on hv-cinder-80473 Jun 20 06:20:01.642827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-c4b73ece-83d6-4a08-8caa-b04be9f8491e req-14df11c7-db72-42bc-a69f-d040d8dab7d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035508 Jun 20 06:20:01.645367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 356/727] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:20:01.733577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:01.743769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:01.745780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:01.747409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-45001b26-fbb3-43a7-aa53-f85ea4b3d561 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.187600 Jun 20 06:20:01.758218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 372/728] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:01 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:01.876022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:01.876954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:01.887624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:01.888597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:01.889945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:01.890766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:01.935817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:01.936384 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:01.937053 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lazy-loading 'fault' on Instance uuid 36614b0c-286e-453d-86f6-88d8150ff347 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:20:01.995265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bf1845390b4c7880c04ae568aea00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018cb579b1dd49db9062d4ddab9c9154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:02.003783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-81938e38-8c84-41eb-b05a-51b4b90690e1 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 200 len: 1327 microversion: 2.1 time: 0.135118 Jun 20 06:20:02.004676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 357/729] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:01 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:02.766899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:02.767626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:02.774381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:02.774860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:02.775628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:02.776068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:02.778792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:02.908027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:02.917773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:02.919562 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:02.920915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7c4630d4-3e8a-40ad-ba57-648ad260fce6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.157927 Jun 20 06:20:02.921613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 373/730] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:02 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:03.022237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:03.022791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:03.029225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:03.029706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:03.030467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:03.030904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:03.046685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] HTTP exception thrown: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Request method failure captured: Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 HTTP/1.1 Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA-HzYfKGXXn1JM9qLnTlmhvP6h2x1xD7-vRvgBIb23FdL6OabyctOXlI6yyRuJRvb1G0FSJ7bs6qE-AtnIF3UhMt60mmAxs09JDeWfBbnX7UBAv6Tm9cdScWGs4ocYApP8MjOTxtg7sz-FUZ4RiHcnS2gmqLsu3-kjebkfqQUs7PWw Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:20:03.048306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}] Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 14bf1845390b4c7880c04ae568aea00a Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:03.049925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '36614b0c-286e-453d-86f6-88d8150ff347'} Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:20:03.050738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:03.051949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:03.053089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Returning 404 to user: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:20:03.053089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-59360676-4da7-43c2-93df-34b42b46d622 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 404 len: 111 microversion: 2.1 time: 0.031728 Jun 20 06:20:03.053089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 358/731] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:03 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:20:03.059442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-90264075-850e-4844-a44d-411bfecf1343 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '.version_select at 0x7f7a7a5ce790>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:03.077349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-90264075-850e-4844-a44d-411bfecf1343 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-770341914" status: 202 len: 0 microversion: 2.1 time: 0.022580 Jun 20 06:20:03.077925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 374/732] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jun 20 06:20:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-770341914 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:20:03.941751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:03.942359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:03.949175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:03.949649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:03.950406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:03.950838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:03.965549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:04.326334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:04.334434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:04.335962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:04.337150 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8c5e455-6415-496f-89da-cf343179bab6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.399351 Jun 20 06:20:04.337742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 359/733] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:03 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:05.356341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:05.356951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:05.362933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:05.363379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:05.364141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:05.364576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:05.499652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:05.507901 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:05.509401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:05.510653 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e320b860-3ef5-430f-b15d-5d7975a87b97 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.158694 Jun 20 06:20:05.511210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 375/734] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:05 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:05.987523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:05.988020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:05.995319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:05.995775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:05.996551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:05.996986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:06.010633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] HTTP exception thrown: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Request method failure captured: Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 HTTP/1.1 Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA-HzYfKGXXn1JM9qLnTlmhvP6h2x1xD7-vRvgBIb23FdL6OabyctOXlI6yyRuJRvb1G0FSJ7bs6qE-AtnIF3UhMt60mmAxs09JDeWfBbnX7UBAv6Tm9cdScWGs4ocYApP8MjOTxtg7sz-FUZ4RiHcnS2gmqLsu3-kjebkfqQUs7PWw Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:20:06.012212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}] Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 14bf1845390b4c7880c04ae568aea00a Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.013759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '36614b0c-286e-453d-86f6-88d8150ff347'} Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:20:06.014651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.016104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.018016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Returning 404 to user: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:20:06.018016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6c221ced-03a7-4cce-bcb6-c747132a0a63 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 404 len: 111 microversion: 2.1 time: 0.029891 Jun 20 06:20:06.018016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 360/735] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:20:05 2022] DELETE /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:20:06.022409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:06.023018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 36614b0c-286e-453d-86f6-88d8150ff347] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:06.024893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:06.031206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:06.031652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:06.032416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:06.032847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:06.047398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] HTTP exception thrown: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Request method failure captured: Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 HTTP/1.1 Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA-HzYfKGXXn1JM9qLnTlmhvP6h2x1xD7-vRvgBIb23FdL6OabyctOXlI6yyRuJRvb1G0FSJ7bs6qE-AtnIF3UhMt60mmAxs09JDeWfBbnX7UBAv6Tm9cdScWGs4ocYApP8MjOTxtg7sz-FUZ4RiHcnS2gmqLsu3-kjebkfqQUs7PWw Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:20:06.049038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}] Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 14bf1845390b4c7880c04ae568aea00a Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.050587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '36614b0c-286e-453d-86f6-88d8150ff347'} Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:20:06.051452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. Jun 20 06:20:06.052962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:06.054328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Returning 404 to user: Instance 36614b0c-286e-453d-86f6-88d8150ff347 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:20:06.054328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c8ba8f2a-e62d-4ff9-912f-1f83bbf0ddaa tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347" status: 404 len: 111 microversion: 2.1 time: 0.032165 Jun 20 06:20:06.054328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 376/736] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:06 2022] GET /compute/v2.1/servers/36614b0c-286e-453d-86f6-88d8150ff347 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:20:06.530447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:06.531288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:06.538908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:06.539502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:06.540609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:06.541200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:06.684622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:06.692772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:06.694344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:06.695509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-673e02ea-7ef3-4505-95e7-d9d5eb70e675 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.170339 Jun 20 06:20:06.696072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 361/737] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:06 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:07.185344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:07.185903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:07.192408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:07.192856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:07.193643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:07.194077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:07.210005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] HTTP exception thrown: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Request method failure captured: Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e HTTP/1.1 Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA-HzYfKGXXn1JM9qLnTlmhvP6h2x1xD7-vRvgBIb23FdL6OabyctOXlI6yyRuJRvb1G0FSJ7bs6qE-AtnIF3UhMt60mmAxs09JDeWfBbnX7UBAv6Tm9cdScWGs4ocYApP8MjOTxtg7sz-FUZ4RiHcnS2gmqLsu3-kjebkfqQUs7PWw Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:20:07.211548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}] Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 14bf1845390b4c7880c04ae568aea00a Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.213060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '7697c07f-5fd2-4b76-87af-0cb70746a73e'} Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:20:07.213990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.215607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.217313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Returning 404 to user: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:20:07.217313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ea18a315-78a9-40d3-861e-f02ab294a8d8 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 404 len: 111 microversion: 2.1 time: 0.031962 Jun 20 06:20:07.217313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 377/738] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:20:07 2022] DELETE /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:20:07.221279 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:07.221944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] [instance: 7697c07f-5fd2-4b76-87af-0cb70746a73e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:07.228369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:07.228817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:07.229618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:07.230485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:07.243450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] HTTP exception thrown: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Request method failure captured: Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e HTTP/1.1 Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA-HzYfKGXXn1JM9qLnTlmhvP6h2x1xD7-vRvgBIb23FdL6OabyctOXlI6yyRuJRvb1G0FSJ7bs6qE-AtnIF3UhMt60mmAxs09JDeWfBbnX7UBAv6Tm9cdScWGs4ocYApP8MjOTxtg7sz-FUZ4RiHcnS2gmqLsu3-kjebkfqQUs7PWw Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:20:07.245952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/018cb579b1dd49db9062d4ddab9c9154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/018cb579b1dd49db9062d4ddab9c9154"}]}] Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 018cb579b1dd49db9062d4ddab9c9154 Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296878024 Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 14bf1845390b4c7880c04ae568aea00a Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-296878024-project Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.247505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '7697c07f-5fd2-4b76-87af-0cb70746a73e'} Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:20:07.248349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. Jun 20 06:20:07.249924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:20:07.251250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] Returning 404 to user: Instance 7697c07f-5fd2-4b76-87af-0cb70746a73e could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:20:07.251250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89bd770e-d5a7-4d86-936c-042ad5b6aa01 tempest-AttachVolumeTestJSON-296878024 tempest-AttachVolumeTestJSON-296878024-project] 10.222.0.16 "GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e" status: 404 len: 111 microversion: 2.1 time: 0.029825 Jun 20 06:20:07.251250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 362/739] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:07 2022] GET /compute/v2.1/servers/7697c07f-5fd2-4b76-87af-0cb70746a73e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:20:07.714509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:07.715124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:07.721198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:07.721697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:07.722662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:07.723100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:07.862542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:07.873019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:07.874987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:07.876276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f3c6bbd7-227e-4605-91db-b5f1f149fbbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1743 microversion: 2.20 time: 0.166226 Jun 20 06:20:07.886058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 378/740] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:07 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:08.896335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:08.896940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:08.904286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:08.904732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:08.905525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:08.906136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:09.056131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:09.068239 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:09.069895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:09.071098 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-207cf745-8dca-493e-a9b6-a34c72d1444b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1743 microversion: 2.20 time: 0.178943 Jun 20 06:20:09.071839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 363/741] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:08 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:09.879095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-564c0427-1cc3-47e0-933a-727d6de034b3 req-c399c5ba-6904-4fa1-a8fa-c96b32efda5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf69dcc-0fce-409f-878a-a3ab64d3b0a0", "name": "network-vif-plugged", "status": "completed", "tag": "f742af21-fda3-4a74-b8b8-aa829f3bab03"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:09.891884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-564c0427-1cc3-47e0-933a-727d6de034b3 req-c399c5ba-6904-4fa1-a8fa-c96b32efda5c service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:09.892549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-564c0427-1cc3-47e0-933a-727d6de034b3 req-c399c5ba-6904-4fa1-a8fa-c96b32efda5c service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:09.908995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-564c0427-1cc3-47e0-933a-727d6de034b3 req-c399c5ba-6904-4fa1-a8fa-c96b32efda5c service nova] Creating event network-vif-plugged:f742af21-fda3-4a74-b8b8-aa829f3bab03 for instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 on hv-cinder-80473 Jun 20 06:20:09.915195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-564c0427-1cc3-47e0-933a-727d6de034b3 req-c399c5ba-6904-4fa1-a8fa-c96b32efda5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041303 Jun 20 06:20:09.917220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 379/742] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:10.094740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:10.095794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:10.107873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:10.109024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:10.110233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:10.110866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:10.304693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:10.313509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:10.315371 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:10.316637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6060baeb-253b-47e4-ab1d-babfb595b8da tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1743 microversion: 2.20 time: 0.228167 Jun 20 06:20:10.317299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 364/743] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:10 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:11.337362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:11.338912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:11.346399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:11.346929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:11.348007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:11.348579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:11.501531 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:11.509556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:11.512083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:11.513215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-716b39f8-12a3-42ae-a4c2-78eb349c9322 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1743 microversion: 2.20 time: 0.180908 Jun 20 06:20:11.524682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 380/744] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:11 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:12.532368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:12.533278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:12.540413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:12.540871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:12.542227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:12.542690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:12.685403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:12.694294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:12.696268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:12.697977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ebb88ad0-99f2-44bb-8074-8ecd4dee84b2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.169446 Jun 20 06:20:12.699115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 365/745] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:12 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:13.717563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:13.718998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:13.730641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:13.731564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:13.732852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:13.733642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:13.968257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:13.980066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:13.981857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:13.983097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a0cf7d2a-7918-464c-91fe-862fe97ed221 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.270253 Jun 20 06:20:13.983734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 381/746] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:13 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:15.001939 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:15.002565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:15.009091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=46 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:15.014288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:15.015297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:15.016395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:15.017231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:15.222174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:15.236604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:15.238346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:15.239903 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-43cd3e7d-04e4-49b6-8b38-7c91c98dd01d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.242114 Jun 20 06:20:15.241080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 366/747] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:14 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:16.260438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:16.261751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:16.270372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:16.271136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:16.272145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:16.272774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:16.544476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:16.557611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:16.559547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:16.561053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eb02e703-ca04-42fb-a2a6-9f56e3a6e6ac tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.306064 Jun 20 06:20:16.569585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 382/748] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:16 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:17.580124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:17.581521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:17.588132 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:17.588866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:17.590043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:17.590645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:17.784317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:17.797412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:17.803258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:17.804973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d83771d5-264f-41e1-a4ca-48cc52a774ce tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.228981 Jun 20 06:20:17.805974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 367/749] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:17 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:18.826950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:18.828233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:18.835937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:18.836668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:18.838616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:18.839220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:19.043987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:19.052570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:19.054199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:19.056346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f366e3a1-3545-485b-b0fb-9e9cfaf46cd3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.233045 Jun 20 06:20:19.071505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 383/750] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:18 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:20.093643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:20.094408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:20.101816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:20.102682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:20.103936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:20.104622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:20.322939 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:20.345302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:20.347842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:20.349785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d404e69f-f1d4-435e-85b4-68dac59bab28 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.261393 Jun 20 06:20:20.361406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 368/751] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:20 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:21.374149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:21.375380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:21.382594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:21.383456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:21.384730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:21.385730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:21.538114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:21.547352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:21.548919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:21.550229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-07f85411-6a35-4db3-a322-851f836e98c4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.181611 Jun 20 06:20:21.551063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 384/752] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:21 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:22.570028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:22.570642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:22.576946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:22.577416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:22.578453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:22.578906 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:22.716229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:22.724124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:22.725666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:22.726818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-747f8558-5e67-44f6-b6b3-51980794d6a9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.161660 Jun 20 06:20:22.727372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 369/753] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:22 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:23.746208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:23.746864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:23.753400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:23.753857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:23.754620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:23.755055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:23.884151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:23.892094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:23.893893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:23.895047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f2f82662-5922-405b-9357-0f0ee72c7863 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.153300 Jun 20 06:20:23.895604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 385/754] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:23 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:24.913588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:24.914201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:24.922203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:24.922774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:24.924098 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:24.924731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:25.062577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:25.070610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:25.072743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:25.073948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7461721c-0193-4b36-ba24-74ce24d4d775 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.164352 Jun 20 06:20:25.074508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 370/755] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:24 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:26.092818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:26.093429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:26.099857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:26.100297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:26.101049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:26.101504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:26.246923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:26.255700 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:26.257191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:26.258378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2d49511c-5502-4eb2-a71b-215e6f832f15 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1738 microversion: 2.20 time: 0.169522 Jun 20 06:20:26.259049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 386/756] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:26 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:27.278392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:27.279019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:27.285565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:27.286053 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:27.287133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:27.287282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:27.523809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:27.533604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:27.535315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:27.536510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-69cf116b-4cb5-4720-b0df-3825b5faee58 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1720 microversion: 2.20 time: 0.262570 Jun 20 06:20:27.537078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 371/757] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:27 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:28.555965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:28.556537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:28.563024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:28.563464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:28.564214 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:28.564643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:28.705810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:28.713838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:28.715339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:28.716505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d62c36d0-6eff-4f41-a2fc-66dbf4211991 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1720 microversion: 2.20 time: 0.164528 Jun 20 06:20:28.717066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 387/758] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:28 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:29.734808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:29.735427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:29.742113 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:29.742569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:29.743336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:29.744346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:29.877198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:29.888267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:29.890204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:29.891838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6970f7f1-ef7d-4a54-9e1f-db0cb56d6b47 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1720 microversion: 2.20 time: 0.160840 Jun 20 06:20:29.892632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 372/759] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:29 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:30.914657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:30.915260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:30.922599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:30.923045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:30.923818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:30.924257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.061345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:31.069303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:31.070828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:31.072618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-21888ea1-4f52-417e-8807-146b1cb01cf7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1720 microversion: 2.20 time: 0.161219 Jun 20 06:20:31.073407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 388/760] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:30 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:31.738153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-15ca0cc3-0bdb-446f-a43a-94a0e13717a0 req-aef6a018-5e68-41ed-8d06-6f1894d05501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf69dcc-0fce-409f-878a-a3ab64d3b0a0", "name": "network-vif-unplugged", "status": "completed", "tag": "f742af21-fda3-4a74-b8b8-aa829f3bab03"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:31.747334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-15ca0cc3-0bdb-446f-a43a-94a0e13717a0 req-aef6a018-5e68-41ed-8d06-6f1894d05501 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.747773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-15ca0cc3-0bdb-446f-a43a-94a0e13717a0 req-aef6a018-5e68-41ed-8d06-6f1894d05501 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.761492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-15ca0cc3-0bdb-446f-a43a-94a0e13717a0 req-aef6a018-5e68-41ed-8d06-6f1894d05501 service nova] Creating event network-vif-unplugged:f742af21-fda3-4a74-b8b8-aa829f3bab03 for instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 on hv-cinder-80473 Jun 20 06:20:31.766862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-15ca0cc3-0bdb-446f-a43a-94a0e13717a0 req-aef6a018-5e68-41ed-8d06-6f1894d05501 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032611 Jun 20 06:20:31.767464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 373/761] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:32.091713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:32.092368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:32.098991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:32.099441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:32.100211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:32.100648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:32.249739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:32.257726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:32.259939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:32.261108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1bcf57fc-5ed2-475f-a7c8-6c0fe6e1ef6c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1720 microversion: 2.20 time: 0.173925 Jun 20 06:20:32.261707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 389/762] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:32 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:33.280696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:33.281306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:33.287523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.287966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.288727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.289159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.424496 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:33.433679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:33.435252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:33.436427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-94c20ce9-b37f-4f4c-9aa8-e59b25576e6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1663 microversion: 2.20 time: 0.160528 Jun 20 06:20:33.436986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 374/763] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:33 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:33.454721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d1c897de-801f-494f-a56d-abf054340a74 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbe5fcaf-e929-4626-bf75-27b8cb463411"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:33.455780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d1c897de-801f-494f-a56d-abf054340a74 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:33.462083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1c897de-801f-494f-a56d-abf054340a74 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.463077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1c897de-801f-494f-a56d-abf054340a74 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.463968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1c897de-801f-494f-a56d-abf054340a74 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.464435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1c897de-801f-494f-a56d-abf054340a74 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.468201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:33.749088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d1c897de-801f-494f-a56d-abf054340a74 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "POST /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298486 Jun 20 06:20:33.749740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 390/764] 10.222.0.16 () {62 vars in 1363 bytes} [Mon Jun 20 06:20:33 2022] POST /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:20:33.862996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-26a12de1-6015-4462-87bb-c212c868721f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:33.863555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-26a12de1-6015-4462-87bb-c212c868721f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:33.870270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26a12de1-6015-4462-87bb-c212c868721f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.870718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26a12de1-6015-4462-87bb-c212c868721f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.871470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26a12de1-6015-4462-87bb-c212c868721f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.871905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26a12de1-6015-4462-87bb-c212c868721f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.965472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-26a12de1-6015-4462-87bb-c212c868721f tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "POST /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/action" status: 202 len: 0 microversion: 2.20 time: 0.106018 Jun 20 06:20:33.966274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 375/765] 10.222.0.16 () {62 vars in 1318 bytes} [Mon Jun 20 06:20:33 2022] POST /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:20:33.974268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:33.974970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:33.983088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.983645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.984414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.984850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:34.122029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:34.130569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:34.132270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:34.133497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5682ea4c-1471-411e-87cd-b70a4b184c29 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1749 microversion: 2.20 time: 0.163108 Jun 20 06:20:34.145354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 391/766] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:33 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:35.153797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:35.154322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:35.161398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:35.161963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:35.162742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:35.163177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:35.168369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:35.305834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:35.315338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:35.316854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:35.318073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-88b59597-c1b5-4d20-bdc7-edb96dc9c8e6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1751 microversion: 2.20 time: 0.169019 Jun 20 06:20:35.318641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 376/767] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:35 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:36.337538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:36.338380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:36.340961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=32 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:36.346414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:36.346867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:36.347664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:36.348131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:36.483747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:36.492106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:36.494639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:36.495991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d5c2e1aa-8d0e-4d77-be34-784303fb8ee2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.162425 Jun 20 06:20:36.496557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 392/768] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:36 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:37.514282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:37.515192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:37.521988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:37.522434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:37.523209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:37.523655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:37.658160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:37.667444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:37.668915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:37.670091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e20f4777-56cb-4fe3-ae91-3e2608ab8da6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.159711 Jun 20 06:20:37.670652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 377/769] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:37 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:38.688420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:38.689025 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:38.695621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:38.696065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:38.697570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:38.698006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:38.828194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:38.836674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:38.838461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:38.839625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-624bc8b8-d817-4fae-91ce-7cefb0fdae95 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.155108 Jun 20 06:20:38.840172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 393/770] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:38 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:39.858523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:39.859135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:39.865957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:39.866414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:39.867188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:39.867632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:40.095515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:40.106424 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:40.109734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:40.111249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4bf90e48-abeb-412c-b477-24a85dcdc8ed tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.256723 Jun 20 06:20:40.112469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 378/771] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:39 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:41.131327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:41.132972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:41.140715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:41.141333 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:41.142286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:41.143294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:41.327689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:41.337303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:41.339001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:41.340192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d2c23b40-e11d-4d19-aede-2db7f7067af8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.213201 Jun 20 06:20:41.351338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 394/772] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:41 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:42.358812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:42.359537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:42.367145 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:42.367661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:42.369367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:42.369915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:42.508686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:42.518124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:42.519895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:42.521064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fea67d54-97eb-4d8c-927e-17e75fc164f0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.166867 Jun 20 06:20:42.521655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 379/773] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:42 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:43.541870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:43.542495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:43.549237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:43.549744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:43.550569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:43.550954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:43.689947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:43.707084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:43.710669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:43.716244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b1e10240-23dc-4d93-a030-c5aa40215494 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.176775 Jun 20 06:20:43.720811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 395/774] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:43 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:44.738313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:44.738924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:44.745796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:44.746255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:44.747025 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:44.747465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:44.881096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:44.889399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:44.890897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:44.892059 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4ef2f31b-7136-44c7-b515-7dbafeab41bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.157834 Jun 20 06:20:44.892614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 380/775] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:44 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:45.910731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:45.911329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:45.918042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:45.918514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:45.919265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:45.919704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:46.047502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:46.056392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:46.057931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:46.059094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d44c7e3e-53da-4bf5-b1e4-db17527d502a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.152334 Jun 20 06:20:46.059649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 396/776] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:45 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:47.078234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:47.078800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:47.080576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=32 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:47.085859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:47.086316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:47.087096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:47.087536 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:47.224040 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:47.236018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:47.238170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:47.239680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2bee720d-c892-4cca-82db-b11a591d6ef9 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.165962 Jun 20 06:20:47.240709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 381/777] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:47 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:48.263955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:48.265368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:48.272893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:48.273697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:48.274913 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:48.275525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:48.460536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:48.470316 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:48.471837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:48.473026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d80d8b1e-2264-498a-ab6a-596a2b4805bc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.214373 Jun 20 06:20:48.473610 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 397/778] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:48 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:49.490995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:49.491637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:49.499218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:49.499934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:49.500872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:49.501498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:49.698329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:49.707263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:49.708740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:49.710164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d83de9b-2d2d-4cc7-841d-13264913dbe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.223070 Jun 20 06:20:49.711212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 382/779] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:49 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:50.730045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:50.730750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:50.738798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:50.739319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:50.740227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:50.740731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:50.900904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:50.912728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:50.914587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:50.917030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-82ca1d8b-0eb3-4fc0-8340-a4179b4fe0b4 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.191820 Jun 20 06:20:50.918141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 398/780] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:50 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:51.936567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:51.938405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:51.958994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.960637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:51.962682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.963795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:52.133486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:52.142643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:52.144404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:52.145619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-07e218c7-6d62-44eb-b823-1499ace1dadc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.213372 Jun 20 06:20:52.146181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 383/781] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:51 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:53.164004 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:53.164617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:53.171359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:53.171806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:53.172571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:53.173018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:53.334100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:53.343821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:53.345325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:53.346704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c0533dde-db54-413b-bb46-4c810fc59e73 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.186577 Jun 20 06:20:53.347261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 399/782] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:53 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:54.365603 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:54.366213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:54.373245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:54.373722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:54.374475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:54.374908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:54.505392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:54.514625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:54.516130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:54.517301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7d2e7c81-9d5e-492c-9f96-87cace3962fa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.155554 Jun 20 06:20:54.517902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 384/783] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:54 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:55.536292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:55.536701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:55.543807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:55.544252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:55.545020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:55.545481 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:55.688577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:55.698405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:55.699891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:55.701077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-216f45c9-4421-4cff-9cbc-c482d3c22fbe tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.168918 Jun 20 06:20:55.701672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 400/784] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:55 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:55.870841 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-756731693", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-447985312", "security_groups": [{"name": "tempest-secgroup-smoke-1692453996"}], "block_device_mapping_v2": [{"uuid": "5009db4a-0772-4423-a056-31e297699599", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73f8a5ee-1f30-4c4c-9916-2c898a38860c"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:55.987267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] validate_networks() for [('73f8a5ee-1f30-4c4c-9916-2c898a38860c', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:20:56.634404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:20:56.634829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:20:56.635326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:20:56.635755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:20:56.636915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:20:56.647234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.647686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:56.648489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.648941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:56.665691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Getting quotas for project a80966bf28184a9f8e9987632f7c0973. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:20:56.670633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Getting quotas for user 6f577abe1ada45979d5cb550073ae6a8 and project a80966bf28184a9f8e9987632f7c0973. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:20:56.720138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:56.720850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:56.728345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.728860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:56.729772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.730356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:56.731058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:20:56.733496 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5009db4a-0772-4423-a056-31e297699599',volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:20:56.872257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-548dcf15-3edb-4156-9d67-60bc17c7ebe0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.005917 Jun 20 06:20:56.872993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 385/785] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:20:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:20:56.881151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:56.883432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fae1fccf-34e7-4d23-88d6-31a44501576b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:56.884060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fae1fccf-34e7-4d23-88d6-31a44501576b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:56.892304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:56.894143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:56.895516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-89977ade-bc4c-4960-a3ba-679991467eff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.179338 Jun 20 06:20:56.896257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 401/786] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:56 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:56.939414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fae1fccf-34e7-4d23-88d6-31a44501576b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:56.946512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fae1fccf-34e7-4d23-88d6-31a44501576b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1093 microversion: 2.1 time: 0.067369 Jun 20 06:20:56.947881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 386/787] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:56 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:57.915499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:57.916256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:57.923763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:57.924205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:57.924966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:57.925406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:57.963714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c419f042-6ade-41a9-8d9b-4a2eafebc9e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:57.964336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c419f042-6ade-41a9-8d9b-4a2eafebc9e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:57.971548 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c419f042-6ade-41a9-8d9b-4a2eafebc9e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:57.971999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c419f042-6ade-41a9-8d9b-4a2eafebc9e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:57.972777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c419f042-6ade-41a9-8d9b-4a2eafebc9e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:57.973216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c419f042-6ade-41a9-8d9b-4a2eafebc9e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:58.050386 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c419f042-6ade-41a9-8d9b-4a2eafebc9e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:58.058528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c419f042-6ade-41a9-8d9b-4a2eafebc9e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1143 microversion: 2.1 time: 0.099110 Jun 20 06:20:58.059107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 387/788] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:57 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1143 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:58.081975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:58.093840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:58.095948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:58.097541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e41242be-51bb-4d7d-b1d6-2787bc149c25 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.185749 Jun 20 06:20:58.098296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 402/789] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:57 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:59.076781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e5be277a-3456-4d64-b84c-1bd795d5056a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:59.077423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e5be277a-3456-4d64-b84c-1bd795d5056a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:59.084965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e5be277a-3456-4d64-b84c-1bd795d5056a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:59.084965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e5be277a-3456-4d64-b84c-1bd795d5056a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:59.085799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e5be277a-3456-4d64-b84c-1bd795d5056a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:59.086242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e5be277a-3456-4d64-b84c-1bd795d5056a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:59.118578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:59.120548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:59.129234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:59.129802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:59.130692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:59.131199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:59.167161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e5be277a-3456-4d64-b84c-1bd795d5056a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:59.183360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e5be277a-3456-4d64-b84c-1bd795d5056a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1209 microversion: 2.1 time: 0.110461 Jun 20 06:20:59.185056 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 388/790] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:59 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:59.371020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:59.379473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:59.380984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:59.382178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9b60c527-50d5-4909-ba30-937eea834f51 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.269670 Jun 20 06:20:59.382753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 403/791] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:59 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:00.201918 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a8caabf3-5356-4a2e-9705-23dab8503008 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:00.203313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a8caabf3-5356-4a2e-9705-23dab8503008 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:00.210557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8caabf3-5356-4a2e-9705-23dab8503008 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.211029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8caabf3-5356-4a2e-9705-23dab8503008 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.212348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8caabf3-5356-4a2e-9705-23dab8503008 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.212786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8caabf3-5356-4a2e-9705-23dab8503008 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.402977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:00.403676 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:00.409864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.410533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.411530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.412297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.420500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a8caabf3-5356-4a2e-9705-23dab8503008 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:00.430669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a8caabf3-5356-4a2e-9705-23dab8503008 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.232933 Jun 20 06:21:00.431872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 389/792] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:00 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:00.444104 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:00.589986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-d19c4ba0-9e54-4c11-a81b-87bbfc79d95d req-ff0f7bd9-9879-4775-9a1b-4e49d166e6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabdd9ee-515b-492e-82b7-aae14f44c6fb", "tag": "4328b13c-3245-46f3-b4dd-7636eaa4cd6f"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:00.607208 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d19c4ba0-9e54-4c11-a81b-87bbfc79d95d req-ff0f7bd9-9879-4775-9a1b-4e49d166e6d4 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.607890 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d19c4ba0-9e54-4c11-a81b-87bbfc79d95d req-ff0f7bd9-9879-4775-9a1b-4e49d166e6d4 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.621713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-d19c4ba0-9e54-4c11-a81b-87bbfc79d95d req-ff0f7bd9-9879-4775-9a1b-4e49d166e6d4 service nova] Creating event network-changed:4328b13c-3245-46f3-b4dd-7636eaa4cd6f for instance cabdd9ee-515b-492e-82b7-aae14f44c6fb on hv-cinder-80473 Jun 20 06:21:00.627610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-d19c4ba0-9e54-4c11-a81b-87bbfc79d95d req-ff0f7bd9-9879-4775-9a1b-4e49d166e6d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043335 Jun 20 06:21:00.628883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 390/793] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:00.778551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:00.788478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:00.790968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:00.792211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1c7485e1-d9c5-4320-8375-26b4ba8ffc04 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.394615 Jun 20 06:21:00.792921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 404/794] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:00 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:01.449635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5241a0dd-9fce-4019-beff-fd110cae35e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:01.450443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5241a0dd-9fce-4019-beff-fd110cae35e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:01.457019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5241a0dd-9fce-4019-beff-fd110cae35e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:01.457509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5241a0dd-9fce-4019-beff-fd110cae35e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:01.458326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5241a0dd-9fce-4019-beff-fd110cae35e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:01.458776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5241a0dd-9fce-4019-beff-fd110cae35e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:01.607989 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5241a0dd-9fce-4019-beff-fd110cae35e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:01.615611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5241a0dd-9fce-4019-beff-fd110cae35e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.171215 Jun 20 06:21:01.616196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 391/795] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:01 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:01.811914 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:01.812734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:01.819610 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:01.820244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:01.821794 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:01.822228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:01.964009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:01.973770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:01.975646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:01.977073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dd0a684a-0519-4118-afff-331174952c6b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.169052 Jun 20 06:21:01.978001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 405/796] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:01 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:02.635106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e3674f19-3b16-4df4-bf15-8d56d2264fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:02.635918 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e3674f19-3b16-4df4-bf15-8d56d2264fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:02.642541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3674f19-3b16-4df4-bf15-8d56d2264fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:02.644316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3674f19-3b16-4df4-bf15-8d56d2264fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:02.645696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3674f19-3b16-4df4-bf15-8d56d2264fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:02.646206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3674f19-3b16-4df4-bf15-8d56d2264fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:02.855922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e3674f19-3b16-4df4-bf15-8d56d2264fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:02.864596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e3674f19-3b16-4df4-bf15-8d56d2264fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.233871 Jun 20 06:21:02.864596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 392/797] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:02 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:02.998771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:02.999385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:03.005598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:03.006048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:03.006815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:03.007249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:03.147054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:03.156590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:03.158130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:03.159335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8bcb4beb-7101-4b78-bd5e-d2f15869bcbc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.164391 Jun 20 06:21:03.170748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 406/798] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:02 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:03.880680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a7f610dc-0afc-477c-b876-00c3f713f41b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:03.881336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a7f610dc-0afc-477c-b876-00c3f713f41b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:03.888325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7f610dc-0afc-477c-b876-00c3f713f41b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:03.888779 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7f610dc-0afc-477c-b876-00c3f713f41b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:03.889587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7f610dc-0afc-477c-b876-00c3f713f41b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:03.890027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7f610dc-0afc-477c-b876-00c3f713f41b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:04.022986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a7f610dc-0afc-477c-b876-00c3f713f41b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:04.031795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a7f610dc-0afc-477c-b876-00c3f713f41b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.155071 Jun 20 06:21:04.032366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 393/799] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:03 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:04.179422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:04.180013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:04.187088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:04.187541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:04.188309 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:04.188750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:04.323302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:04.331877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:04.333357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:04.334549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1bd378df-ad7b-4f25-ab6c-ed091848d8ec tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.159867 Jun 20 06:21:04.335105 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 407/800] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:04 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:05.049281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-99c6b5fa-fafe-4ee8-a119-44a3a4a3553d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:05.050033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-99c6b5fa-fafe-4ee8-a119-44a3a4a3553d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:05.060110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99c6b5fa-fafe-4ee8-a119-44a3a4a3553d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:05.060589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99c6b5fa-fafe-4ee8-a119-44a3a4a3553d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:05.061738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99c6b5fa-fafe-4ee8-a119-44a3a4a3553d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:05.061916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99c6b5fa-fafe-4ee8-a119-44a3a4a3553d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:05.201317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-99c6b5fa-fafe-4ee8-a119-44a3a4a3553d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:05.203672 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:05.210309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-99c6b5fa-fafe-4ee8-a119-44a3a4a3553d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.165436 Jun 20 06:21:05.210875 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 394/801] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:05 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:05.352280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:05.352902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:05.359552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:05.360004 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:05.360775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:05.361210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:05.489675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:05.498636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:05.500145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:05.501311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d80b0f89-9e6b-4ce3-93c1-a97dbefae823 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.153157 Jun 20 06:21:05.501923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 408/802] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:05 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:06.228177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-11b31016-9785-4f62-addb-6aa478163361 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:06.229089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-11b31016-9785-4f62-addb-6aa478163361 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:06.235534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11b31016-9785-4f62-addb-6aa478163361 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.235985 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11b31016-9785-4f62-addb-6aa478163361 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.236747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11b31016-9785-4f62-addb-6aa478163361 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.237182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11b31016-9785-4f62-addb-6aa478163361 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.382028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-11b31016-9785-4f62-addb-6aa478163361 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:06.389733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-11b31016-9785-4f62-addb-6aa478163361 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.166035 Jun 20 06:21:06.390295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 395/803] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:06 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:06.522349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:06.523056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:06.525996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=34 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:06.531782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.532241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.533006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.533457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.673966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:06.683291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:06.684789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:06.685984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d1948a29-e999-44aa-8bfd-06de8fc587c3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.167788 Jun 20 06:21:06.686550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 409/804] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:06 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:07.407520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f8216487-6a78-4638-8575-c6f8977017bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:07.408135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f8216487-6a78-4638-8575-c6f8977017bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:07.410142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:07.411009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=8 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:07.418728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8216487-6a78-4638-8575-c6f8977017bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.419178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8216487-6a78-4638-8575-c6f8977017bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.419956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8216487-6a78-4638-8575-c6f8977017bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.420389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8216487-6a78-4638-8575-c6f8977017bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.557364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f8216487-6a78-4638-8575-c6f8977017bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:07.564833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f8216487-6a78-4638-8575-c6f8977017bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.161158 Jun 20 06:21:07.565324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 396/805] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:07 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:07.715982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:07.716590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:07.723112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.723555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.724316 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.724750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.856568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:07.865346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:07.866847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:07.868139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a92a11d7-bb6c-4586-a1df-5c1452191940 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.156710 Jun 20 06:21:07.868895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 410/806] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:07 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:08.034244 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-92061292-a7e7-4254-89f2-ec144dd0850b req-e03f09cd-b1e9-4927-adb2-d8b1115c1173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf69dcc-0fce-409f-878a-a3ab64d3b0a0", "name": "network-vif-plugged", "status": "completed", "tag": "f742af21-fda3-4a74-b8b8-aa829f3bab03"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:08.043074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-92061292-a7e7-4254-89f2-ec144dd0850b req-e03f09cd-b1e9-4927-adb2-d8b1115c1173 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:08.043760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-92061292-a7e7-4254-89f2-ec144dd0850b req-e03f09cd-b1e9-4927-adb2-d8b1115c1173 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:08.057867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-92061292-a7e7-4254-89f2-ec144dd0850b req-e03f09cd-b1e9-4927-adb2-d8b1115c1173 service nova] Creating event network-vif-plugged:f742af21-fda3-4a74-b8b8-aa829f3bab03 for instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 on hv-cinder-80473 Jun 20 06:21:08.063758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-92061292-a7e7-4254-89f2-ec144dd0850b req-e03f09cd-b1e9-4927-adb2-d8b1115c1173 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033037 Jun 20 06:21:08.064446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 397/807] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:08.581457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e8f79a34-0d77-4e6a-8936-75090237425f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:08.582140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e8f79a34-0d77-4e6a-8936-75090237425f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:08.589354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8f79a34-0d77-4e6a-8936-75090237425f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:08.589829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8f79a34-0d77-4e6a-8936-75090237425f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:08.590604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8f79a34-0d77-4e6a-8936-75090237425f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:08.591039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8f79a34-0d77-4e6a-8936-75090237425f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:08.743661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e8f79a34-0d77-4e6a-8936-75090237425f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:08.752731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e8f79a34-0d77-4e6a-8936-75090237425f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.175177 Jun 20 06:21:08.753660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 411/808] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:08 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:08.887438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:08.888131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:08.894585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:08.895029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:08.895788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:08.896219 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:09.036480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:09.045112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:09.046644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:09.047808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d5b5ec90-aa39-4b76-ba91-018ceb7be0ff tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.165721 Jun 20 06:21:09.048379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 398/809] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:08 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:09.770069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-da693909-3514-4778-a45c-291fe3288fa0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:09.770698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-da693909-3514-4778-a45c-291fe3288fa0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:09.777250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da693909-3514-4778-a45c-291fe3288fa0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:09.777741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da693909-3514-4778-a45c-291fe3288fa0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:09.778522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da693909-3514-4778-a45c-291fe3288fa0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:09.778963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da693909-3514-4778-a45c-291fe3288fa0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:09.927933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-da693909-3514-4778-a45c-291fe3288fa0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:09.936043 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-da693909-3514-4778-a45c-291fe3288fa0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.170017 Jun 20 06:21:09.936624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 412/810] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:09 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:10.069282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:10.070326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:10.080299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.080299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:10.080299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.083356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:10.236927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:10.245493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:10.247042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:10.248294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b1a064a8-6ce1-4ac9-a3e1-09568d413d36 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.185951 Jun 20 06:21:10.249000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 399/811] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:10 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:10.952578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b15157a3-1921-455a-b4a7-88398866708f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:10.953233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b15157a3-1921-455a-b4a7-88398866708f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:10.959773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b15157a3-1921-455a-b4a7-88398866708f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.960215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b15157a3-1921-455a-b4a7-88398866708f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:10.961000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b15157a3-1921-455a-b4a7-88398866708f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.961442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b15157a3-1921-455a-b4a7-88398866708f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:11.093042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b15157a3-1921-455a-b4a7-88398866708f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:11.100460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b15157a3-1921-455a-b4a7-88398866708f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.151691 Jun 20 06:21:11.101009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 413/812] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:10 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:11.266684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:11.267221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:11.274253 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:11.274738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:11.275512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:11.275944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:11.412282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:11.422076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:11.423586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:11.424757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-420035b5-e559-4534-b39e-fe0632cc5caa tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.161985 Jun 20 06:21:11.425338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 400/813] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:11 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:12.118568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-905379f9-8770-4db1-a65d-981357cedbe4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:12.119262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-905379f9-8770-4db1-a65d-981357cedbe4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:12.125944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-905379f9-8770-4db1-a65d-981357cedbe4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:12.126428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-905379f9-8770-4db1-a65d-981357cedbe4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:12.127168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-905379f9-8770-4db1-a65d-981357cedbe4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:12.127600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-905379f9-8770-4db1-a65d-981357cedbe4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:12.263013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-905379f9-8770-4db1-a65d-981357cedbe4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:12.271004 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-905379f9-8770-4db1-a65d-981357cedbe4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.157177 Jun 20 06:21:12.271496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 414/814] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:12 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:12.443490 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:12.444091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:12.451356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:12.451799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:12.452560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:12.452991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:12.589744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:12.598031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:12.599506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:12.600669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-72d24f45-cf7a-42aa-9a57-e7407ef9288e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.161054 Jun 20 06:21:12.601226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 401/815] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:12 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:13.290473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a68c0081-a8c3-4421-a154-985f9acd9440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:13.291364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a68c0081-a8c3-4421-a154-985f9acd9440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:13.297957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a68c0081-a8c3-4421-a154-985f9acd9440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:13.298412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a68c0081-a8c3-4421-a154-985f9acd9440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:13.299192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a68c0081-a8c3-4421-a154-985f9acd9440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:13.299637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a68c0081-a8c3-4421-a154-985f9acd9440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:13.432216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a68c0081-a8c3-4421-a154-985f9acd9440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:13.439649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a68c0081-a8c3-4421-a154-985f9acd9440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.154937 Jun 20 06:21:13.440212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 415/816] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:13 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:13.620259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:13.620784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:13.627325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:13.627780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:13.628559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:13.629001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:13.759922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:13.768579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:13.770120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:13.771325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff1ece91-afbd-4cbf-967f-4696b7112124 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.156024 Jun 20 06:21:13.771895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 402/817] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:13 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:14.457113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ef880265-8cd1-4965-b181-8a84bbc388b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:14.457764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ef880265-8cd1-4965-b181-8a84bbc388b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:14.464722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef880265-8cd1-4965-b181-8a84bbc388b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:14.465178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef880265-8cd1-4965-b181-8a84bbc388b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:14.465974 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef880265-8cd1-4965-b181-8a84bbc388b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:14.466413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef880265-8cd1-4965-b181-8a84bbc388b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:14.602460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ef880265-8cd1-4965-b181-8a84bbc388b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:14.609940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ef880265-8cd1-4965-b181-8a84bbc388b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.156731 Jun 20 06:21:14.610503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 416/818] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:14 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:14.791332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:14.791952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:14.798009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:14.798461 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:14.799234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:14.799676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:14.927946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:14.937132 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:14.938667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:14.939828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-125edf4b-bd16-4ffd-98fc-366c8436cff6 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.153446 Jun 20 06:21:14.940393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 403/819] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:14 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:15.627289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45779eba-719a-47af-9910-d2cf5b46a398 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:15.627807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-45779eba-719a-47af-9910-d2cf5b46a398 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:15.635067 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45779eba-719a-47af-9910-d2cf5b46a398 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:15.635518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45779eba-719a-47af-9910-d2cf5b46a398 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:15.636288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45779eba-719a-47af-9910-d2cf5b46a398 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:15.636725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45779eba-719a-47af-9910-d2cf5b46a398 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:15.775307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-45779eba-719a-47af-9910-d2cf5b46a398 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:15.783204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-45779eba-719a-47af-9910-d2cf5b46a398 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.159880 Jun 20 06:21:15.783785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 417/820] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:15 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:15.958021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:15.958675 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:15.965521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:15.966205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:15.966978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:15.967406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:16.001601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-b63776e0-f0fc-4dc3-9e6b-e53eb77eb7f5 req-75e3f436-54da-4287-8234-64ce6c1eaa84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabdd9ee-515b-492e-82b7-aae14f44c6fb", "name": "network-vif-plugged", "status": "completed", "tag": "4328b13c-3245-46f3-b4dd-7636eaa4cd6f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:16.023962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-b63776e0-f0fc-4dc3-9e6b-e53eb77eb7f5 req-75e3f436-54da-4287-8234-64ce6c1eaa84 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:16.024735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-b63776e0-f0fc-4dc3-9e6b-e53eb77eb7f5 req-75e3f436-54da-4287-8234-64ce6c1eaa84 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:16.041281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-b63776e0-f0fc-4dc3-9e6b-e53eb77eb7f5 req-75e3f436-54da-4287-8234-64ce6c1eaa84 service nova] Creating event network-vif-plugged:4328b13c-3245-46f3-b4dd-7636eaa4cd6f for instance cabdd9ee-515b-492e-82b7-aae14f44c6fb on hv-cinder-80473 Jun 20 06:21:16.048703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-b63776e0-f0fc-4dc3-9e6b-e53eb77eb7f5 req-75e3f436-54da-4287-8234-64ce6c1eaa84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054416 Jun 20 06:21:16.050182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 418/821] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:16.112306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:16.122835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:16.124347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:16.125593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-57f629d2-ce0d-47c0-a3f6-706f8b5958e0 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1807 microversion: 2.20 time: 0.171475 Jun 20 06:21:16.126454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 404/822] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:15 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:16.800499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a40ca6c9-8862-495c-938d-b3c93d73b52a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:16.801277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a40ca6c9-8862-495c-938d-b3c93d73b52a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:16.808424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a40ca6c9-8862-495c-938d-b3c93d73b52a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:16.808985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a40ca6c9-8862-495c-938d-b3c93d73b52a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:16.809863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a40ca6c9-8862-495c-938d-b3c93d73b52a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:16.810403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a40ca6c9-8862-495c-938d-b3c93d73b52a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:17.007419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a40ca6c9-8862-495c-938d-b3c93d73b52a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:17.015721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a40ca6c9-8862-495c-938d-b3c93d73b52a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1265 microversion: 2.1 time: 0.219615 Jun 20 06:21:17.016293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 419/823] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:16 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:17.144381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:17.145000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:17.147494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:17.152947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:17.153425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:17.154212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:17.154663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:17.292814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:17.302776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:17.304605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:17.306592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f0b20c7e-4002-4899-9edc-6a5e96a3b0dd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1794 microversion: 2.20 time: 0.166422 Jun 20 06:21:17.307297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 405/824] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:17 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:17.498597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:21:17.498819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:21:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:21:18.033626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a52f07cd-b13b-4f4c-97f3-79359d0540a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:18.034350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a52f07cd-b13b-4f4c-97f3-79359d0540a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:18.041998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a52f07cd-b13b-4f4c-97f3-79359d0540a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:18.042603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a52f07cd-b13b-4f4c-97f3-79359d0540a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:18.043572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a52f07cd-b13b-4f4c-97f3-79359d0540a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:18.044019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a52f07cd-b13b-4f4c-97f3-79359d0540a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:18.182589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a52f07cd-b13b-4f4c-97f3-79359d0540a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:18.190105 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a52f07cd-b13b-4f4c-97f3-79359d0540a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1453 microversion: 2.1 time: 0.161731 Jun 20 06:21:18.190711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 420/825] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:18 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:18.206550 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d9626165-ca95-4ef0-8ad5-1b313e942c0b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:18.207164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d9626165-ca95-4ef0-8ad5-1b313e942c0b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:18.214423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9626165-ca95-4ef0-8ad5-1b313e942c0b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:18.214877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9626165-ca95-4ef0-8ad5-1b313e942c0b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:18.215651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9626165-ca95-4ef0-8ad5-1b313e942c0b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:18.216093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9626165-ca95-4ef0-8ad5-1b313e942c0b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:18.353991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d9626165-ca95-4ef0-8ad5-1b313e942c0b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:18.361618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d9626165-ca95-4ef0-8ad5-1b313e942c0b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1453 microversion: 2.1 time: 0.158905 Jun 20 06:21:18.362186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 406/826] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:18 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:20.875706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-889624e3-c20c-43b2-9341-395187ecf90d req-f69a7037-9a4e-4a30-aea0-41855fcdffc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabdd9ee-515b-492e-82b7-aae14f44c6fb", "tag": "4328b13c-3245-46f3-b4dd-7636eaa4cd6f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:20.884618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-889624e3-c20c-43b2-9341-395187ecf90d req-f69a7037-9a4e-4a30-aea0-41855fcdffc1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:20.885066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-889624e3-c20c-43b2-9341-395187ecf90d req-f69a7037-9a4e-4a30-aea0-41855fcdffc1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:20.896408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-889624e3-c20c-43b2-9341-395187ecf90d req-f69a7037-9a4e-4a30-aea0-41855fcdffc1 service nova] Creating event network-changed:4328b13c-3245-46f3-b4dd-7636eaa4cd6f for instance cabdd9ee-515b-492e-82b7-aae14f44c6fb on hv-cinder-80473 Jun 20 06:21:20.901992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-889624e3-c20c-43b2-9341-395187ecf90d req-f69a7037-9a4e-4a30-aea0-41855fcdffc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030288 Jun 20 06:21:20.902598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 421/827] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:23.828497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e82d0db2-7c31-4bae-b0ef-63aa77de1db9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:23.829171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e82d0db2-7c31-4bae-b0ef-63aa77de1db9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:23.836697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e82d0db2-7c31-4bae-b0ef-63aa77de1db9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:23.837149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e82d0db2-7c31-4bae-b0ef-63aa77de1db9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:23.837997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e82d0db2-7c31-4bae-b0ef-63aa77de1db9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:23.838436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e82d0db2-7c31-4bae-b0ef-63aa77de1db9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:23.863194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e82d0db2-7c31-4bae-b0ef-63aa77de1db9 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/ips" status: 200 len: 150 microversion: 2.1 time: 0.038401 Jun 20 06:21:23.863933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 407/828] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:21:23 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:25.187763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cd3ffc6f-ff58-41eb-be26-2edc4dbcac99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52fd9066-3cf0-4719-b1ef-e224baf35142"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:25.188896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cd3ffc6f-ff58-41eb-be26-2edc4dbcac99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:25.195147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd3ffc6f-ff58-41eb-be26-2edc4dbcac99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:25.195906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd3ffc6f-ff58-41eb-be26-2edc4dbcac99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:25.196680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd3ffc6f-ff58-41eb-be26-2edc4dbcac99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:25.197115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd3ffc6f-ff58-41eb-be26-2edc4dbcac99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:25.200809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:25.512633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cd3ffc6f-ff58-41eb-be26-2edc4dbcac99 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "POST /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329673 Jun 20 06:21:25.513196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 422/829] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:21:25 2022] POST /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:33.138022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-af0788be-36bd-4ad6-b16d-94fabab31685 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:33.138534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-af0788be-36bd-4ad6-b16d-94fabab31685 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:33.145522 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af0788be-36bd-4ad6-b16d-94fabab31685 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:33.145977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af0788be-36bd-4ad6-b16d-94fabab31685 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:33.146747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af0788be-36bd-4ad6-b16d-94fabab31685 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:33.147191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af0788be-36bd-4ad6-b16d-94fabab31685 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:33.355119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-af0788be-36bd-4ad6-b16d-94fabab31685 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lazy-loading 'services' on Instance uuid 0db26865-a90b-41a0-9a7a-75e98e68eded {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:21:33.429313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-af0788be-36bd-4ad6-b16d-94fabab31685 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments/52fd9066-3cf0-4719-b1ef-e224baf35142" status: 202 len: 0 microversion: 2.1 time: 0.294796 Jun 20 06:21:33.430054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 408/830] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:21:33 2022] DELETE /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments/52fd9066-3cf0-4719-b1ef-e224baf35142 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:21:33.439442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3c4472e2-82c3-4d65-a6a8-2fd21ca4d1d8 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:33.440853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3c4472e2-82c3-4d65-a6a8-2fd21ca4d1d8 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:33.447049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c4472e2-82c3-4d65-a6a8-2fd21ca4d1d8 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:33.447504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c4472e2-82c3-4d65-a6a8-2fd21ca4d1d8 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:33.448269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c4472e2-82c3-4d65-a6a8-2fd21ca4d1d8 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:33.448885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c4472e2-82c3-4d65-a6a8-2fd21ca4d1d8 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:33.480052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3c4472e2-82c3-4d65-a6a8-2fd21ca4d1d8 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045390 Jun 20 06:21:33.480624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 423/831] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:21:33 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:34.492175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9b552832-0bef-4580-8c4a-6a1a18612256 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:34.493181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9b552832-0bef-4580-8c4a-6a1a18612256 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:34.500907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b552832-0bef-4580-8c4a-6a1a18612256 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:34.501708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b552832-0bef-4580-8c4a-6a1a18612256 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:34.502492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b552832-0bef-4580-8c4a-6a1a18612256 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:34.503158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b552832-0bef-4580-8c4a-6a1a18612256 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:34.534656 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9b552832-0bef-4580-8c4a-6a1a18612256 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047467 Jun 20 06:21:34.535219 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 409/832] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:21:34 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:35.546785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-01f5933c-c76a-492b-a7fe-3803e5c1a43d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:35.547697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-01f5933c-c76a-492b-a7fe-3803e5c1a43d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:35.554734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01f5933c-c76a-492b-a7fe-3803e5c1a43d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:35.555181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01f5933c-c76a-492b-a7fe-3803e5c1a43d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:35.556084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01f5933c-c76a-492b-a7fe-3803e5c1a43d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:35.556568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01f5933c-c76a-492b-a7fe-3803e5c1a43d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:35.591062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-01f5933c-c76a-492b-a7fe-3803e5c1a43d tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048088 Jun 20 06:21:35.591527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 424/833] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jun 20 06:21:35 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:21:35.652148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a3f7f4ac-c5b7-450a-96bd-bc0898808ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:35.652702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a3f7f4ac-c5b7-450a-96bd-bc0898808ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:35.659144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3f7f4ac-c5b7-450a-96bd-bc0898808ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:35.659599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3f7f4ac-c5b7-450a-96bd-bc0898808ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:35.660372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3f7f4ac-c5b7-450a-96bd-bc0898808ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:35.660813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3f7f4ac-c5b7-450a-96bd-bc0898808ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:35.664091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:35.688165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a3f7f4ac-c5b7-450a-96bd-bc0898808ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:21:35.760944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a3f7f4ac-c5b7-450a-96bd-bc0898808ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 204 len: 0 microversion: 2.1 time: 0.112877 Jun 20 06:21:35.761940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 410/834] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:21:35 2022] DELETE /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:21:35.771440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4f040404-99aa-4fe8-80b5-437d17775dad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:35.772045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4f040404-99aa-4fe8-80b5-437d17775dad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:35.778513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f040404-99aa-4fe8-80b5-437d17775dad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:35.778989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f040404-99aa-4fe8-80b5-437d17775dad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:35.779746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f040404-99aa-4fe8-80b5-437d17775dad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:35.780175 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f040404-99aa-4fe8-80b5-437d17775dad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:35.997089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4f040404-99aa-4fe8-80b5-437d17775dad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:36.004541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4f040404-99aa-4fe8-80b5-437d17775dad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1681 microversion: 2.1 time: 0.238174 Jun 20 06:21:36.005099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 425/835] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:35 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:37.023898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89774fa5-b100-466e-b67d-571626f241ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:37.024609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-89774fa5-b100-466e-b67d-571626f241ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:37.031075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89774fa5-b100-466e-b67d-571626f241ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:37.031533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89774fa5-b100-466e-b67d-571626f241ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:37.032316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89774fa5-b100-466e-b67d-571626f241ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:37.032757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89774fa5-b100-466e-b67d-571626f241ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:37.162971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-89774fa5-b100-466e-b67d-571626f241ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:37.171358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89774fa5-b100-466e-b67d-571626f241ba tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1681 microversion: 2.1 time: 0.152273 Jun 20 06:21:37.171933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 411/836] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:37 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:38.189042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fa4feee4-d1dd-4fb2-b23c-756174e5ad34 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:38.189802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fa4feee4-d1dd-4fb2-b23c-756174e5ad34 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:38.192557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=34 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:38.199299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa4feee4-d1dd-4fb2-b23c-756174e5ad34 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:38.199788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa4feee4-d1dd-4fb2-b23c-756174e5ad34 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:38.200670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa4feee4-d1dd-4fb2-b23c-756174e5ad34 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:38.201150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa4feee4-d1dd-4fb2-b23c-756174e5ad34 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:38.339575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fa4feee4-d1dd-4fb2-b23c-756174e5ad34 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:38.348404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fa4feee4-d1dd-4fb2-b23c-756174e5ad34 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1681 microversion: 2.1 time: 0.163998 Jun 20 06:21:38.349052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 426/837] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:38 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:39.367377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b82d1bc3-5a49-42b4-a138-ae055840d890 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:39.367377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b82d1bc3-5a49-42b4-a138-ae055840d890 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:39.374432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b82d1bc3-5a49-42b4-a138-ae055840d890 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:39.374956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b82d1bc3-5a49-42b4-a138-ae055840d890 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:39.375732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b82d1bc3-5a49-42b4-a138-ae055840d890 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:39.376172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b82d1bc3-5a49-42b4-a138-ae055840d890 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:39.469469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b82d1bc3-5a49-42b4-a138-ae055840d890 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7405c2b1504907ba919e2797e63754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde00bac11024d898d6d87b8d2abc29e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:39.469776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-5415053d-1ea1-4b08-962c-2651171c66bb req-4e52f80c-5f99-462e-ae2f-ca3720950c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db26865-a90b-41a0-9a7a-75e98e68eded", "name": "network-vif-deleted", "tag": "d6e94c11-8472-406c-9fc8-764818ed527c"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:39.479694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b82d1bc3-5a49-42b4-a138-ae055840d890 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 200 len: 1614 microversion: 2.1 time: 0.116763 Jun 20 06:21:39.480277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 412/838] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:39 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:39.481253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-5415053d-1ea1-4b08-962c-2651171c66bb req-4e52f80c-5f99-462e-ae2f-ca3720950c3c service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:39.481824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-5415053d-1ea1-4b08-962c-2651171c66bb req-4e52f80c-5f99-462e-ae2f-ca3720950c3c service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:39.502024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-5415053d-1ea1-4b08-962c-2651171c66bb req-4e52f80c-5f99-462e-ae2f-ca3720950c3c service nova] Creating event network-vif-deleted:d6e94c11-8472-406c-9fc8-764818ed527c for instance 0db26865-a90b-41a0-9a7a-75e98e68eded on hv-cinder-80473 Jun 20 06:21:39.513879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-5415053d-1ea1-4b08-962c-2651171c66bb req-4e52f80c-5f99-462e-ae2f-ca3720950c3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048233 Jun 20 06:21:39.517646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 427/839] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:40.497266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:40.498043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:40.504681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:40.505131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:40.505925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:40.506357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:40.520342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded HTTP/1.1 Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:21:40.521940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:40.524228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '0db26865-a90b-41a0-9a7a-75e98e68eded'} Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:40.525419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:40.527005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:40.528595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:40.528595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-92bee1f2-166c-485a-bc56-540d2d4d8654 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 404 len: 111 microversion: 2.1 time: 0.030861 Jun 20 06:21:40.528595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 413/840] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:40 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:40.533727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-01baaddb-ec9d-41ed-b21f-296809fc829f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '.version_select at 0x7f7a7a527160>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:40.550957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-01baaddb-ec9d-41ed-b21f-296809fc829f tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200320437" status: 202 len: 0 microversion: 2.1 time: 0.021854 Jun 20 06:21:40.551522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 428/841] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Jun 20 06:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200320437 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:21:42.533698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:42.534393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:42.541437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:42.541883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:42.542674 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:42.543103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:42.559481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded HTTP/1.1 Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:21:42.561051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.562645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '0db26865-a90b-41a0-9a7a-75e98e68eded'} Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:42.563587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.565048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.566512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:42.566512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a852036f-c98b-43b8-a40d-7d81941a6106 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 404 len: 111 microversion: 2.1 time: 0.032677 Jun 20 06:21:42.566512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 414/842] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:21:42 2022] DELETE /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:42.571323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:42.572069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 0db26865-a90b-41a0-9a7a-75e98e68eded] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:42.579383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:42.579838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:42.580603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:42.581089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:42.595548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded HTTP/1.1 Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:21:42.597189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.598833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '0db26865-a90b-41a0-9a7a-75e98e68eded'} Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:42.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. Jun 20 06:21:42.601782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:42.603020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance 0db26865-a90b-41a0-9a7a-75e98e68eded could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:42.603020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5596ba56-761c-4259-8c03-c53c4f0c6530 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded" status: 404 len: 111 microversion: 2.1 time: 0.031583 Jun 20 06:21:42.603020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 429/843] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:42 2022] GET /compute/v2.1/servers/0db26865-a90b-41a0-9a7a-75e98e68eded => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:43.733632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:43.734134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:43.740720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.741771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.742541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.742976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.756391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 HTTP/1.1 Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:21:43.758576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.760201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': 'f341d742-be1b-4305-96ef-cebe35a09f86'} Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:43.761256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.762753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.764569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:43.764569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-177c294d-f639-4795-9000-6f1349071215 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 404 len: 111 microversion: 2.1 time: 0.030213 Jun 20 06:21:43.764569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 415/844] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:21:43 2022] DELETE /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:43.768615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:43.769221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: f341d742-be1b-4305-96ef-cebe35a09f86] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:43.776141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.776593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.777366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.777859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.791379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 HTTP/1.1 Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:21:43.792905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.794506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'f341d742-be1b-4305-96ef-cebe35a09f86'} Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:43.796108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. Jun 20 06:21:43.797691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.798999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance f341d742-be1b-4305-96ef-cebe35a09f86 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:43.798999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b5635ef8-7ad6-464e-9521-c4e2432b4804 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86" status: 404 len: 111 microversion: 2.1 time: 0.029799 Jun 20 06:21:43.798999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 430/845] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:43 2022] GET /compute/v2.1/servers/f341d742-be1b-4305-96ef-cebe35a09f86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:43.802785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:43.803318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:43.810113 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.810565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.811354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.811786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.825657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 HTTP/1.1 Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:21:43.827184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1'} Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:43.829922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.831212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.832553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:43.832553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a1354ed9-fc62-4d06-96e0-b08cd9952c09 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 404 len: 111 microversion: 2.1 time: 0.029680 Jun 20 06:21:43.832553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 416/846] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:21:43 2022] DELETE /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:43.837076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:43.837784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:43.844107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.844500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.845171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.845636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.859083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 HTTP/1.1 Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:21:43.860788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.862225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1'} Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:43.862968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. Jun 20 06:21:43.864437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:43.867268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance 124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:43.867268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6ccf2d73-d112-4d56-ab44-75e0063b3ab7 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1" status: 404 len: 111 microversion: 2.1 time: 0.028877 Jun 20 06:21:43.867268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 431/847] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:43 2022] GET /compute/v2.1/servers/124ebb67-c3f3-4d2e-b493-e5a5ce9a51e1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:45.004401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:45.004908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:45.011459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:45.011912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:45.012687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:45.013127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:45.030387 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f HTTP/1.1 Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:21:45.032339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.033663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': 'aa304480-6854-41f6-8fdc-6cf9581ca96f'} Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:45.034429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.035769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.037406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:45.037406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8c6cc0d7-7b52-4ad6-a09f-e371ea20df13 tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 404 len: 111 microversion: 2.1 time: 0.034193 Jun 20 06:21:45.037406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 417/848] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:21:44 2022] DELETE /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:45.042890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:45.043506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] [instance: aa304480-6854-41f6-8fdc-6cf9581ca96f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:45.049965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:45.050418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:45.051185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:45.051629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:45.064981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] HTTP exception thrown: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Request method failure captured: Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f HTTP/1.1 Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisA_hVEXTtWxtcQdIwBSW6h-czDtolkTmSEpvJIC0_FaisKEdprbP_yXFBy6uhE6OHdbxoQS7efvURdBvuaiJ6QNnktTu0TzBOZkiOeS7F4rGCaV6mqthZMOxaNnP-dc-d7Pn9heiy143lgUmUvA8TxEpxoi8c9WjLctCcYijHkhSbGM Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:21:45.066541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde00bac11024d898d6d87b8d2abc29e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde00bac11024d898d6d87b8d2abc29e"}]}] Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: fde00bac11024d898d6d87b8d2abc29e Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911242816 Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: ee7405c2b1504907ba919e2797e63754 Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1911242816-project Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.068210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'aa304480-6854-41f6-8fdc-6cf9581ca96f'} Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:45.069141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. Jun 20 06:21:45.071419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:45.072866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] Returning 404 to user: Instance aa304480-6854-41f6-8fdc-6cf9581ca96f could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:45.072866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b96246de-591d-4dc9-bf69-fa57ffa95cad tempest-AttachVolumeNegativeTest-1911242816 tempest-AttachVolumeNegativeTest-1911242816-project] 10.222.0.16 "GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f" status: 404 len: 111 microversion: 2.1 time: 0.028838 Jun 20 06:21:45.072866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 432/849] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:45 2022] GET /compute/v2.1/servers/aa304480-6854-41f6-8fdc-6cf9581ca96f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:49.361785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-90b77edd-0626-4526-8ebb-ffdc3bfc4562 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Action: 'create', calling method: .version_select at 0x7f7a7a7478b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1507350342", "metadata": {"Type": "work"}}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-90b77edd-0626-4526-8ebb-ffdc3bfc4562 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Request method failure captured: Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 122 Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBH9xn_yEKgW03tPV_D6RveHwjf2qIfD-yuQ0ikUnZiHrQe-Y-QPn8FVk0bxE6dmA7IOtcQHxtDPJDBizZDtJ5I80HdgYR-ubS9ncCLyB2WOVQq4JrrKbGntplHIkwlCT-6GBpXRuTFe6DFBQTvZYGPJ7228pQVAtr769DfKqShnNRM Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:21:49.377756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}] Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: e79cbb8209b4490eb07ff830ad9e9c36 Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1507350342", "metadata": {"Type": "work"}}} Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: Jun 20 06:21:49.379346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1507350342', 'metadata': {'Type': 'work'}}}} Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:49.380271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:21:49.382247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:21:49.383426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:21:49.383426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.383426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-90b77edd-0626-4526-8ebb-ffdc3bfc4562 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:49.383426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-90b77edd-0626-4526-8ebb-ffdc3bfc4562 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136879 Jun 20 06:21:49.383426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 418/850] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jun 20 06:21:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:21:49.390862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad65d755-ab43-4192-beb2-0117bc8c393b tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Action: 'create', calling method: .version_select at 0x7f7a7a4d5b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-742952825", "metadata": {"Type": "work"}}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad65d755-ab43-4192-beb2-0117bc8c393b tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Request method failure captured: Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 119 Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBH9xn_yEKgW03tPV_D6RveHwjf2qIfD-yuQ0ikUnZiHrQe-Y-QPn8FVk0bxE6dmA7IOtcQHxtDPJDBizZDtJ5I80HdgYR-ubS9ncCLyB2WOVQq4JrrKbGntplHIkwlCT-6GBpXRuTFe6DFBQTvZYGPJ7228pQVAtr769DfKqShnNRM Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:21:49.394394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}] Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: e79cbb8209b4490eb07ff830ad9e9c36 Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-742952825", "metadata": {"Type": "work"}}} Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: Jun 20 06:21:49.397991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-742952825', 'metadata': {'Type': 'work'}}}} Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi '0' Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:49.399176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:21:49.400671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:21:49.402183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:21:49.402183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.402183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad65d755-ab43-4192-beb2-0117bc8c393b tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:49.402183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ad65d755-ab43-4192-beb2-0117bc8c393b tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008779 Jun 20 06:21:49.402183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 433/851] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jun 20 06:21:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:21:49.407474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-68821861-7141-4a0b-ab0e-516193a31379 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Action: 'create', calling method: .version_select at 0x7f7a7a592c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1134251464", "metadata": {"Type": "work"}}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-68821861-7141-4a0b-ab0e-516193a31379 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Request method failure captured: Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 119 Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBH9xn_yEKgW03tPV_D6RveHwjf2qIfD-yuQ0ikUnZiHrQe-Y-QPn8FVk0bxE6dmA7IOtcQHxtDPJDBizZDtJ5I80HdgYR-ubS9ncCLyB2WOVQq4JrrKbGntplHIkwlCT-6GBpXRuTFe6DFBQTvZYGPJ7228pQVAtr769DfKqShnNRM Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:21:49.409849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}] Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: e79cbb8209b4490eb07ff830ad9e9c36 Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1134251464", "metadata": {"Type": "work"}}} Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: Jun 20 06:21:49.412032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1134251464', 'metadata': {'Type': 'work'}}}} Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi '' Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:49.413713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:21:49.416231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:21:49.418860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:21:49.418860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.418860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-68821861-7141-4a0b-ab0e-516193a31379 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:49.418860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-68821861-7141-4a0b-ab0e-516193a31379 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007972 Jun 20 06:21:49.418860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 419/852] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jun 20 06:21:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:21:49.422898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f6c29aad-fbe7-48d2-a532-f65426e0fe5a tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Calling method '.version_select at 0x7f7a7a4b0ca0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:49.453289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-f6c29aad-fbe7-48d2-a532-f65426e0fe5a tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] HTTP exception thrown: Volume tempest-invalid-1507599601 could not be found. Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f6c29aad-fbe7-48d2-a532-f65426e0fe5a tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Request method failure captured: Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1507599601 HTTP/1.1 Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBH9xn_yEKgW03tPV_D6RveHwjf2qIfD-yuQ0ikUnZiHrQe-Y-QPn8FVk0bxE6dmA7IOtcQHxtDPJDBizZDtJ5I80HdgYR-ubS9ncCLyB2WOVQq4JrrKbGntplHIkwlCT-6GBpXRuTFe6DFBQTvZYGPJ7228pQVAtr769DfKqShnNRM Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:21:49.455319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}] Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: e79cbb8209b4490eb07ff830ad9e9c36 Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Volume tempest-invalid-1507599601 could not be found. Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'tempest-invalid-1507599601'} Jun 20 06:21:49.456678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1507599601 could not be found. (HTTP 404) (Request-ID: req-39436789-dd5f-49af-9fc7-ba058e3bfa08) Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.457734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:21:49.458956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1507599601 could not be found. Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:49.460798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1507599601 could not be found. Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1507599601 could not be found. Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f6c29aad-fbe7-48d2-a532-f65426e0fe5a tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Returning 404 to user: Volume tempest-invalid-1507599601 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f6c29aad-fbe7-48d2-a532-f65426e0fe5a tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1507599601" status: 404 len: 99 microversion: 2.1 time: 0.038439 Jun 20 06:21:49.462010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 434/853] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jun 20 06:21:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1507599601 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 06:21:49.467973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5d0e2a42-19f9-4fd6-be0c-a3acc49695c3 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004767 Jun 20 06:21:49.468476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 420/854] 10.222.0.16 () {58 vars in 1139 bytes} [Mon Jun 20 06:21:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 06:21:49.477439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8e59751f-8a65-4f50-a431-0d84899b8143 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003813 Jun 20 06:21:49.477970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 435/855] 10.222.0.16 () {58 vars in 1136 bytes} [Mon Jun 20 06:21:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 06:21:49.486265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3beebcd5-74bd-41fe-8eee-2be40fcf7641 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Calling method '.version_select at 0x7f7a7a747790>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:49.515026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-3beebcd5-74bd-41fe-8eee-2be40fcf7641 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] HTTP exception thrown: Volume f92a2839-a326-426e-8b25-f92f6e1a72c9 could not be found. Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3beebcd5-74bd-41fe-8eee-2be40fcf7641 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Request method failure captured: Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/os-volumes/f92a2839-a326-426e-8b25-f92f6e1a72c9 HTTP/1.1 Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBH9xn_yEKgW03tPV_D6RveHwjf2qIfD-yuQ0ikUnZiHrQe-Y-QPn8FVk0bxE6dmA7IOtcQHxtDPJDBizZDtJ5I80HdgYR-ubS9ncCLyB2WOVQq4JrrKbGntplHIkwlCT-6GBpXRuTFe6DFBQTvZYGPJ7228pQVAtr769DfKqShnNRM Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:21:49.518572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}] Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: e79cbb8209b4490eb07ff830ad9e9c36 Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Volume f92a2839-a326-426e-8b25-f92f6e1a72c9 could not be found. Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': 'f92a2839-a326-426e-8b25-f92f6e1a72c9'} Jun 20 06:21:49.520140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f92a2839-a326-426e-8b25-f92f6e1a72c9 could not be found. (HTTP 404) (Request-ID: req-36589513-6610-46df-8a8d-61826a5db02b) Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.521894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:21:49.524037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f92a2839-a326-426e-8b25-f92f6e1a72c9 could not be found. Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:21:49.525508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f92a2839-a326-426e-8b25-f92f6e1a72c9 could not be found. Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f92a2839-a326-426e-8b25-f92f6e1a72c9 could not be found. Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3beebcd5-74bd-41fe-8eee-2be40fcf7641 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Returning 404 to user: Volume f92a2839-a326-426e-8b25-f92f6e1a72c9 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3beebcd5-74bd-41fe-8eee-2be40fcf7641 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f92a2839-a326-426e-8b25-f92f6e1a72c9" status: 404 len: 109 microversion: 2.1 time: 0.037340 Jun 20 06:21:49.526860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 421/856] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jun 20 06:21:49 2022] DELETE /compute/v2.1/os-volumes/f92a2839-a326-426e-8b25-f92f6e1a72c9 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:21:49.530168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a6686086-412e-4514-8557-021c6d199a95 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Calling method '.version_select at 0x7f7a7a711ee0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:49.557372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-a6686086-412e-4514-8557-021c6d199a95 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] HTTP exception thrown: Volume f8539ffa-50c7-43cf-8b97-52c973b1255b could not be found. Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a6686086-412e-4514-8557-021c6d199a95 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Request method failure captured: Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/os-volumes/f8539ffa-50c7-43cf-8b97-52c973b1255b HTTP/1.1 Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBH9xn_yEKgW03tPV_D6RveHwjf2qIfD-yuQ0ikUnZiHrQe-Y-QPn8FVk0bxE6dmA7IOtcQHxtDPJDBizZDtJ5I80HdgYR-ubS9ncCLyB2WOVQq4JrrKbGntplHIkwlCT-6GBpXRuTFe6DFBQTvZYGPJ7228pQVAtr769DfKqShnNRM Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:21:49.559583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54023511410c4e259f8f33bc8a1849e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54023511410c4e259f8f33bc8a1849e5"}]}] Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 54023511410c4e259f8f33bc8a1849e5 Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesNegativeTest-1355318496 Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: e79cbb8209b4490eb07ff830ad9e9c36 Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesNegativeTest-1355318496-project Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Volume f8539ffa-50c7-43cf-8b97-52c973b1255b could not be found. Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'f8539ffa-50c7-43cf-8b97-52c973b1255b'} Jun 20 06:21:49.561150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8539ffa-50c7-43cf-8b97-52c973b1255b could not be found. (HTTP 404) (Request-ID: req-7e5787b8-5394-4b08-86cc-05cb11310e50) Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.562160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:21:49.563540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8539ffa-50c7-43cf-8b97-52c973b1255b could not be found. Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:21:49.565250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8539ffa-50c7-43cf-8b97-52c973b1255b could not be found. Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8539ffa-50c7-43cf-8b97-52c973b1255b could not be found. Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a6686086-412e-4514-8557-021c6d199a95 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] Returning 404 to user: Volume f8539ffa-50c7-43cf-8b97-52c973b1255b could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a6686086-412e-4514-8557-021c6d199a95 tempest-VolumesNegativeTest-1355318496 tempest-VolumesNegativeTest-1355318496-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f8539ffa-50c7-43cf-8b97-52c973b1255b" status: 404 len: 109 microversion: 2.1 time: 0.034711 Jun 20 06:21:49.566658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 436/857] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jun 20 06:21:49 2022] GET /compute/v2.1/os-volumes/f8539ffa-50c7-43cf-8b97-52c973b1255b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:56.895272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:56.896074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:56.901500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-948803364", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "networks": [{"uuid": "4ebe20bb-cc19-4a24-9e9e-399319f18128"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:56.956827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] validate_networks() for [('4ebe20bb-cc19-4a24-9e9e-399319f18128', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:21:57.350669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:21:57.351310 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:21:57.351788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:21:57.352194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:21:57.352598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:21:57.361538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:57.362021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:57.362816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:57.363241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:57.382444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Getting quotas for project ef4cdcfeeefd4d598f28a1316087944f. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:21:57.386646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Getting quotas for user 0a38dccab9404882be501aeb64a228f6 and project ef4cdcfeeefd4d598f28a1316087944f. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:21:57.397781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:21:57.400114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:21:57.450481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-54ea6e58-0c49-49f3-9a14-f82851e2e2dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556954 Jun 20 06:21:57.451134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 422/858] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:21:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:21:57.458479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:57.459292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:57.465251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4ff44638-cbe8-49f7-85bd-83fca6a5927a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:57.466011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4ff44638-cbe8-49f7-85bd-83fca6a5927a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:57.527891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4ff44638-cbe8-49f7-85bd-83fca6a5927a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:57.535829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4ff44638-cbe8-49f7-85bd-83fca6a5927a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1218 microversion: 2.1 time: 0.078458 Jun 20 06:21:57.536403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 437/859] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:57 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:58.553546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cd33b2e2-87aa-411c-9e1e-3ce93975e247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:58.554816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cd33b2e2-87aa-411c-9e1e-3ce93975e247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:58.563407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd33b2e2-87aa-411c-9e1e-3ce93975e247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:58.564260 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd33b2e2-87aa-411c-9e1e-3ce93975e247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:58.565328 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd33b2e2-87aa-411c-9e1e-3ce93975e247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:58.566014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd33b2e2-87aa-411c-9e1e-3ce93975e247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:58.918093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cd33b2e2-87aa-411c-9e1e-3ce93975e247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:58.925691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cd33b2e2-87aa-411c-9e1e-3ce93975e247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1288 microversion: 2.1 time: 0.376059 Jun 20 06:21:58.935925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 423/860] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:58 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1288 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:59.943195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-944e8bf1-a765-4b4e-8b82-830363440cb2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:59.949308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-944e8bf1-a765-4b4e-8b82-830363440cb2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:59.956253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-944e8bf1-a765-4b4e-8b82-830363440cb2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:59.956779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-944e8bf1-a765-4b4e-8b82-830363440cb2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:59.957823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-944e8bf1-a765-4b4e-8b82-830363440cb2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:59.958639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-944e8bf1-a765-4b4e-8b82-830363440cb2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:00.190337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-944e8bf1-a765-4b4e-8b82-830363440cb2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:00.202660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-944e8bf1-a765-4b4e-8b82-830363440cb2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1318 microversion: 2.1 time: 0.263710 Jun 20 06:22:00.203238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 438/861] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:59 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:00.655961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-52a9e6b7-45f5-4f64-9c08-baeecab402e9 req-a3be5f17-0128-4fc9-b48a-58e63c7db5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb55995-a9da-4681-b95f-11657fea5562", "tag": "7776b16e-74cc-45ad-9fbe-dcbcd64c7b21"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:00.665369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-52a9e6b7-45f5-4f64-9c08-baeecab402e9 req-a3be5f17-0128-4fc9-b48a-58e63c7db5ff service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:00.665867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-52a9e6b7-45f5-4f64-9c08-baeecab402e9 req-a3be5f17-0128-4fc9-b48a-58e63c7db5ff service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:00.677344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-52a9e6b7-45f5-4f64-9c08-baeecab402e9 req-a3be5f17-0128-4fc9-b48a-58e63c7db5ff service nova] Creating event network-changed:7776b16e-74cc-45ad-9fbe-dcbcd64c7b21 for instance 4cb55995-a9da-4681-b95f-11657fea5562 on hv-cinder-80473 Jun 20 06:22:00.683347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-52a9e6b7-45f5-4f64-9c08-baeecab402e9 req-a3be5f17-0128-4fc9-b48a-58e63c7db5ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177831 Jun 20 06:22:00.684135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 424/862] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:01.220812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b12999c5-13d1-4d08-9bf4-e162f3d80c3a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:01.222044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b12999c5-13d1-4d08-9bf4-e162f3d80c3a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:01.229373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b12999c5-13d1-4d08-9bf4-e162f3d80c3a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:01.229957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b12999c5-13d1-4d08-9bf4-e162f3d80c3a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:01.230789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b12999c5-13d1-4d08-9bf4-e162f3d80c3a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:01.231297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b12999c5-13d1-4d08-9bf4-e162f3d80c3a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:01.367440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b12999c5-13d1-4d08-9bf4-e162f3d80c3a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:01.375233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b12999c5-13d1-4d08-9bf4-e162f3d80c3a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1318 microversion: 2.1 time: 0.159081 Jun 20 06:22:01.382787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 439/863] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:01 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:02.393733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24431916-20d0-42c2-bc05-0f3f7a424123 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:02.394378 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24431916-20d0-42c2-bc05-0f3f7a424123 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:02.401207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24431916-20d0-42c2-bc05-0f3f7a424123 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:02.401695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24431916-20d0-42c2-bc05-0f3f7a424123 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:02.402470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24431916-20d0-42c2-bc05-0f3f7a424123 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:02.402902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24431916-20d0-42c2-bc05-0f3f7a424123 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:02.547921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24431916-20d0-42c2-bc05-0f3f7a424123 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:02.556206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24431916-20d0-42c2-bc05-0f3f7a424123 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1318 microversion: 2.1 time: 0.167508 Jun 20 06:22:02.565976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 425/864] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:02 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:03.573948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-94c964b8-2a6c-4a15-bb67-50d833b6c407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:03.575145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-94c964b8-2a6c-4a15-bb67-50d833b6c407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:03.582960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94c964b8-2a6c-4a15-bb67-50d833b6c407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:03.583710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94c964b8-2a6c-4a15-bb67-50d833b6c407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:03.585515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94c964b8-2a6c-4a15-bb67-50d833b6c407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:03.586154 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94c964b8-2a6c-4a15-bb67-50d833b6c407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:03.837673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-94c964b8-2a6c-4a15-bb67-50d833b6c407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:03.847021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-94c964b8-2a6c-4a15-bb67-50d833b6c407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1318 microversion: 2.1 time: 0.277041 Jun 20 06:22:03.847623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 440/865] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:03 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:04.864485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-76309641-9b3d-4a47-9867-cf608e26890c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:04.865305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-76309641-9b3d-4a47-9867-cf608e26890c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:04.873011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76309641-9b3d-4a47-9867-cf608e26890c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:04.873633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76309641-9b3d-4a47-9867-cf608e26890c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:04.874865 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76309641-9b3d-4a47-9867-cf608e26890c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:04.875531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76309641-9b3d-4a47-9867-cf608e26890c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:05.130494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76309641-9b3d-4a47-9867-cf608e26890c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:05.138405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-76309641-9b3d-4a47-9867-cf608e26890c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1318 microversion: 2.1 time: 0.278018 Jun 20 06:22:05.148374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 426/866] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:04 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:06.157642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eeb8a958-4e4c-4dd2-ba8c-23cc26ec42ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:06.159210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eeb8a958-4e4c-4dd2-ba8c-23cc26ec42ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:06.168769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eeb8a958-4e4c-4dd2-ba8c-23cc26ec42ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:06.171415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eeb8a958-4e4c-4dd2-ba8c-23cc26ec42ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:06.173017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eeb8a958-4e4c-4dd2-ba8c-23cc26ec42ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:06.173737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eeb8a958-4e4c-4dd2-ba8c-23cc26ec42ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:06.339498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eeb8a958-4e4c-4dd2-ba8c-23cc26ec42ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:06.347791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eeb8a958-4e4c-4dd2-ba8c-23cc26ec42ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1318 microversion: 2.1 time: 0.195719 Jun 20 06:22:06.348403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 441/867] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:06 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:06.661185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-ceaaed7a-d40b-476a-bd8f-178278cd30d1 req-777aa366-ba5e-40c0-bf63-47354de548d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb55995-a9da-4681-b95f-11657fea5562", "name": "network-vif-plugged", "status": "completed", "tag": "7776b16e-74cc-45ad-9fbe-dcbcd64c7b21"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:06.677917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ceaaed7a-d40b-476a-bd8f-178278cd30d1 req-777aa366-ba5e-40c0-bf63-47354de548d1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:06.679930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ceaaed7a-d40b-476a-bd8f-178278cd30d1 req-777aa366-ba5e-40c0-bf63-47354de548d1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:06.692750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-ceaaed7a-d40b-476a-bd8f-178278cd30d1 req-777aa366-ba5e-40c0-bf63-47354de548d1 service nova] Creating event network-vif-plugged:7776b16e-74cc-45ad-9fbe-dcbcd64c7b21 for instance 4cb55995-a9da-4681-b95f-11657fea5562 on hv-cinder-80473 Jun 20 06:22:06.701652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-ceaaed7a-d40b-476a-bd8f-178278cd30d1 req-777aa366-ba5e-40c0-bf63-47354de548d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046451 Jun 20 06:22:06.702568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 427/868] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:07.366088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-af5485a7-e462-4f89-833c-9fc994a7b1cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:07.366708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-af5485a7-e462-4f89-833c-9fc994a7b1cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:07.385949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af5485a7-e462-4f89-833c-9fc994a7b1cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:07.386639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af5485a7-e462-4f89-833c-9fc994a7b1cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:07.387749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af5485a7-e462-4f89-833c-9fc994a7b1cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:07.388350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af5485a7-e462-4f89-833c-9fc994a7b1cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:07.536276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:07.617849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-af5485a7-e462-4f89-833c-9fc994a7b1cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:07.627779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-af5485a7-e462-4f89-833c-9fc994a7b1cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1318 microversion: 2.1 time: 0.266083 Jun 20 06:22:07.642347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 442/869] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:07 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:08.644338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:08.645427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:08.650775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b02fe10e-3ea6-4255-ab66-032b04dcd357 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:08.651488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b02fe10e-3ea6-4255-ab66-032b04dcd357 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:08.663864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b02fe10e-3ea6-4255-ab66-032b04dcd357 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:08.664323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b02fe10e-3ea6-4255-ab66-032b04dcd357 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:08.665106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b02fe10e-3ea6-4255-ab66-032b04dcd357 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:08.665571 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b02fe10e-3ea6-4255-ab66-032b04dcd357 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:08.841416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b02fe10e-3ea6-4255-ab66-032b04dcd357 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:08.849355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b02fe10e-3ea6-4255-ab66-032b04dcd357 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1318 microversion: 2.1 time: 0.206174 Jun 20 06:22:08.850616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 428/870] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:08 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:09.868558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c01c0e0a-9b54-43c1-8860-04cb4b82204d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:09.870753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c01c0e0a-9b54-43c1-8860-04cb4b82204d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:09.878591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c01c0e0a-9b54-43c1-8860-04cb4b82204d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:09.879458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c01c0e0a-9b54-43c1-8860-04cb4b82204d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:09.880502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c01c0e0a-9b54-43c1-8860-04cb4b82204d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:09.881243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c01c0e0a-9b54-43c1-8860-04cb4b82204d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:10.121356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c01c0e0a-9b54-43c1-8860-04cb4b82204d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:10.133786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c01c0e0a-9b54-43c1-8860-04cb4b82204d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1506 microversion: 2.1 time: 0.270429 Jun 20 06:22:10.167275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 443/871] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:09 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:11.937757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7216f447-8945-4c26-a68f-6c74d45669bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Action: 'create', calling method: .version_select at 0x7f7a7a5e40d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-388905979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoOlJmzxqYO6tzSxB+sPPZdOg9UBj+KhNi8DDy7FSYWC050+WLi8A1B9RChqR+PIlPCCF89IG6yJAda/6kU5o6ofkItNhuhpdA/J7OFDyrH+Oqe9TU2OZhunp8KJP8lQ=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:11.952640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-7216f447-8945-4c26-a68f-6c74d45669bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Getting quotas for project 0346509d863b4c7bb2534206aa76fcd3. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:22:11.956624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-7216f447-8945-4c26-a68f-6c74d45669bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Getting quotas for user 571d90a992034d7ea37016cee355a716 and project 0346509d863b4c7bb2534206aa76fcd3. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:22:11.983834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7216f447-8945-4c26-a68f-6c74d45669bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.270576 Jun 20 06:22:11.984616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 429/872] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jun 20 06:22:11 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:34.260635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2fa1abe6-fdd2-4cba-b08c-ad62e03d8b4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:34.261206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2fa1abe6-fdd2-4cba-b08c-ad62e03d8b4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:34.263184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=16 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:34.263890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=36 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:34.270137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fa1abe6-fdd2-4cba-b08c-ad62e03d8b4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:34.270591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fa1abe6-fdd2-4cba-b08c-ad62e03d8b4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:34.271466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fa1abe6-fdd2-4cba-b08c-ad62e03d8b4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:34.271902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fa1abe6-fdd2-4cba-b08c-ad62e03d8b4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:34.304808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2fa1abe6-fdd2-4cba-b08c-ad62e03d8b4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments/fbe5fcaf-e929-4626-bf75-27b8cb463411" status: 200 len: 194 microversion: 2.20 time: 0.047856 Jun 20 06:22:34.305428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 444/873] 10.222.0.16 () {60 vars in 1453 bytes} [Mon Jun 20 06:22:34 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments/fbe5fcaf-e929-4626-bf75-27b8cb463411 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:22:34.367519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=30 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:34.368290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:34.369186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:34.373649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-79c9d821-0d27-4ec7-aa57-a1144f20286c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:34.374174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-79c9d821-0d27-4ec7-aa57-a1144f20286c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:34.382713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79c9d821-0d27-4ec7-aa57-a1144f20286c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:34.383173 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79c9d821-0d27-4ec7-aa57-a1144f20286c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:34.383949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79c9d821-0d27-4ec7-aa57-a1144f20286c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:34.384392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79c9d821-0d27-4ec7-aa57-a1144f20286c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:34.465003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-79c9d821-0d27-4ec7-aa57-a1144f20286c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lazy-loading 'services' on Instance uuid bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:22:34.538546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-79c9d821-0d27-4ec7-aa57-a1144f20286c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments/fbe5fcaf-e929-4626-bf75-27b8cb463411" status: 202 len: 0 microversion: 2.20 time: 0.172184 Jun 20 06:22:34.539156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 430/874] 10.222.0.16 () {60 vars in 1456 bytes} [Mon Jun 20 06:22:34 2022] DELETE /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments/fbe5fcaf-e929-4626-bf75-27b8cb463411 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:22:34.553886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fd80773d-782f-4a10-9b7e-204fb82eb13e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:34.555248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fd80773d-782f-4a10-9b7e-204fb82eb13e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:34.562672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd80773d-782f-4a10-9b7e-204fb82eb13e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:34.563131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd80773d-782f-4a10-9b7e-204fb82eb13e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:34.563970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd80773d-782f-4a10-9b7e-204fb82eb13e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:34.564402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd80773d-782f-4a10-9b7e-204fb82eb13e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:34.596636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fd80773d-782f-4a10-9b7e-204fb82eb13e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049114 Jun 20 06:22:34.597188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 445/875] 10.222.0.16 () {60 vars in 1342 bytes} [Mon Jun 20 06:22:34 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:22:35.610158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-afb454c2-7c52-4ccf-acad-2e20cb6d61f2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:35.611342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-afb454c2-7c52-4ccf-acad-2e20cb6d61f2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:35.619863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-afb454c2-7c52-4ccf-acad-2e20cb6d61f2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:35.620312 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-afb454c2-7c52-4ccf-acad-2e20cb6d61f2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:35.621079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-afb454c2-7c52-4ccf-acad-2e20cb6d61f2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:35.621539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-afb454c2-7c52-4ccf-acad-2e20cb6d61f2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:35.653518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-afb454c2-7c52-4ccf-acad-2e20cb6d61f2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048313 Jun 20 06:22:35.654094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 431/876] 10.222.0.16 () {60 vars in 1342 bytes} [Mon Jun 20 06:22:35 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:22:36.665207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-83812359-e0ec-42f2-957d-2ad34a530bbd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:36.666193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-83812359-e0ec-42f2-957d-2ad34a530bbd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:36.672725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83812359-e0ec-42f2-957d-2ad34a530bbd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:36.673176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83812359-e0ec-42f2-957d-2ad34a530bbd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:36.673979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83812359-e0ec-42f2-957d-2ad34a530bbd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:36.674426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83812359-e0ec-42f2-957d-2ad34a530bbd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:36.703521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-83812359-e0ec-42f2-957d-2ad34a530bbd tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042288 Jun 20 06:22:36.704077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 446/877] 10.222.0.16 () {60 vars in 1342 bytes} [Mon Jun 20 06:22:36 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:36.761323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0fa84eae-f1b2-4c42-94bf-812c5b9de43e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:36.761977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0fa84eae-f1b2-4c42-94bf-812c5b9de43e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:36.768548 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fa84eae-f1b2-4c42-94bf-812c5b9de43e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:36.769004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fa84eae-f1b2-4c42-94bf-812c5b9de43e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:36.769808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fa84eae-f1b2-4c42-94bf-812c5b9de43e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:36.770252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fa84eae-f1b2-4c42-94bf-812c5b9de43e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:36.798828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0fa84eae-f1b2-4c42-94bf-812c5b9de43e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:22:36.876123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0fa84eae-f1b2-4c42-94bf-812c5b9de43e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 204 len: 0 microversion: 2.20 time: 0.118339 Jun 20 06:22:36.876726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 432/878] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Jun 20 06:22:36 2022] DELETE /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 06:22:36.885558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:36.886109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:36.892073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:36.892524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:36.893624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:36.894059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:37.024962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:37.032925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:37.034439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:37.035586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a178efa9-2c1e-42cb-b1f7-ba75d37573e8 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.154068 Jun 20 06:22:37.036155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 447/879] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:36 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:22:38.054683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:38.055383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:38.062542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:38.062989 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:38.063753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:38.064179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:38.204104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:38.212503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:38.214035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:38.215290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0cbcaabf-6d9a-479e-9e66-b1076e616633 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.164854 Jun 20 06:22:38.215849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 433/880] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:38 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:22:39.233769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:39.234387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:39.240586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:39.241046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:39.241853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:39.242287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:39.405860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:39.414888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:39.416552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:39.417801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0635614d-5ff1-42e7-a523-e33d624a3791 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1722 microversion: 2.20 time: 0.187823 Jun 20 06:22:39.418358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 448/881] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:39 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:22:40.214000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-ae80d907-4c55-4955-b4aa-1efd804400a8 req-993e22ae-2fc0-4d50-94d7-6a4fb5c8e802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf69dcc-0fce-409f-878a-a3ab64d3b0a0", "name": "network-vif-deleted", "tag": "f742af21-fda3-4a74-b8b8-aa829f3bab03"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:40.222721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ae80d907-4c55-4955-b4aa-1efd804400a8 req-993e22ae-2fc0-4d50-94d7-6a4fb5c8e802 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:40.223163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ae80d907-4c55-4955-b4aa-1efd804400a8 req-993e22ae-2fc0-4d50-94d7-6a4fb5c8e802 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:40.428657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-ae80d907-4c55-4955-b4aa-1efd804400a8 req-993e22ae-2fc0-4d50-94d7-6a4fb5c8e802 service nova] Creating event network-vif-deleted:f742af21-fda3-4a74-b8b8-aa829f3bab03 for instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 on hv-cinder-80473 Jun 20 06:22:40.437343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-ae80d907-4c55-4955-b4aa-1efd804400a8 req-993e22ae-2fc0-4d50-94d7-6a4fb5c8e802 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228761 Jun 20 06:22:40.438184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 434/882] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:40.440965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:40.441713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:40.450270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:40.450971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:40.451781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:40.452208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:40.492793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:40.493245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:40.493723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lazy-loading 'fault' on Instance uuid bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:22:40.535879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:40.548380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:40.549942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:40.551267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-118b0b71-890e-45f2-a2c3-c777bdd3a753 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 200 len: 1370 microversion: 2.20 time: 0.118769 Jun 20 06:22:40.551672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 449/883] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:40 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 1370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:22:41.572496 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:41.573186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:41.579722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:41.580173 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:41.580984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:41.581491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:41.595180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] HTTP exception thrown: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Request method failure captured: Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 HTTP/1.1 Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBEqJDeZtlG-76F9Hi4_noX4_tneao6vpYIiYQyaYvdpuOkX8aoM1hpdwBXJme_lnOgm3F_vrfWtSCxavSew2AgbdU00NoRsq1ru6feT1r9ReY4KmDcnf7fvgIEVVBT7oFxAdaOflWS25iHWid_ZHHLne8-r_H3tLh3LxO6zrjUIz_g Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:22:41.596826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}] Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 5fc0e8fe250349d699ea43aeee98170e Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:22:41.599707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': 'bbf69dcc-0fce-409f-878a-a3ab64d3b0a0'} Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:41.600821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:22:41.602437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:22:41.603931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Returning 404 to user: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:41.603931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ffbbeb46-2ea8-45ae-8f31-30ac0cbf5b5c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 404 len: 111 microversion: 2.20 time: 0.030584 Jun 20 06:22:41.603931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 435/884] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:41 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:22:41.608681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d5c07c38-66de-4943-9301-0bc1c1f21c2c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '.version_select at 0x7f7a7a4aa3a0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:41.624830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d5c07c38-66de-4943-9301-0bc1c1f21c2c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-287983682" status: 204 len: 0 microversion: 2.20 time: 0.020042 Jun 20 06:22:41.625307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 450/885] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Jun 20 06:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-287983682 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 06:22:42.251506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1a3c6b8a-3bdf-4e86-8bc9-3a1c56e77f4b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Action: 'create', calling method: .version_select at 0x7f7a7a548a60>, body: {"keypair": {"name": "tempest-keypair-1596981346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/2Bc6DpgFxVb/0fEmIo2hyAVaJVHunOMwa0Fv3cBvTwrxANuNDC8/1sgLD2IgGcOy8XJav9gvIEB5/wPyJX8OMlId0zuQupb9cDSQLHgKQQfT3hia0T+1OgiBSilTrZg=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:42.266982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-1a3c6b8a-3bdf-4e86-8bc9-3a1c56e77f4b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Getting quotas for project 8a2203406ec34776ab1a1e663601baaf. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:22:42.272061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-1a3c6b8a-3bdf-4e86-8bc9-3a1c56e77f4b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Getting quotas for user 5fc0e8fe250349d699ea43aeee98170e and project 8a2203406ec34776ab1a1e663601baaf. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:22:42.302389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1a3c6b8a-3bdf-4e86-8bc9-3a1c56e77f4b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.054028 Jun 20 06:22:42.303139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 436/886] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Jun 20 06:22:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 06:22:42.479596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f6b6eb74-1be6-4d44-972a-dd16c278961b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c6a62a8-0adf-4bfe-ad43-b31bc0da460c", "device": "/dev/sdb"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:42.481261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f6b6eb74-1be6-4d44-972a-dd16c278961b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:42.488511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f6b6eb74-1be6-4d44-972a-dd16c278961b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:42.488958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f6b6eb74-1be6-4d44-972a-dd16c278961b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:42.490452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f6b6eb74-1be6-4d44-972a-dd16c278961b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:42.490884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f6b6eb74-1be6-4d44-972a-dd16c278961b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:42.761336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f6b6eb74-1be6-4d44-972a-dd16c278961b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "POST /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285835 Jun 20 06:22:42.766649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 451/887] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:22:42 2022] POST /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:43.660343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2004012532", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b38f118d-b9b9-4cf3-9e9d-8aa5b8ffa500"}], "security_groups": [{"name": "tempest-securitygroup--985676404"}], "key_name": "tempest-keypair-1596981346", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:43.761868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] validate_networks() for [('b38f118d-b9b9-4cf3-9e9d-8aa5b8ffa500', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:22:44.238982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:22:44.240213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:22:44.240687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:22:44.241099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:22:44.241539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:22:44.250403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:44.250848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:44.251646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:44.252083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:44.268529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Getting quotas for project 8a2203406ec34776ab1a1e663601baaf. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:22:44.272495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Getting quotas for user 5fc0e8fe250349d699ea43aeee98170e and project 8a2203406ec34776ab1a1e663601baaf. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:22:44.283265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:22:44.285571 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:22:44.349401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0837181b-90b7-41d1-afb4-e9b951a2b721 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.693247 Jun 20 06:22:44.350048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 437/888] 10.222.0.16 () {62 vars in 1187 bytes} [Mon Jun 20 06:22:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 06:22:44.361325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7ef8971f-d466-4798-96e2-a2c2febb1e06 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:44.362156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7ef8971f-d466-4798-96e2-a2c2febb1e06 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:44.418918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7ef8971f-d466-4798-96e2-a2c2febb1e06 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:44.426190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7ef8971f-d466-4798-96e2-a2c2febb1e06 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:44.427782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7ef8971f-d466-4798-96e2-a2c2febb1e06 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:44.428888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7ef8971f-d466-4798-96e2-a2c2febb1e06 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1282 microversion: 2.20 time: 0.072446 Jun 20 06:22:44.429685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 452/889] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:44 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:22:45.447463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:45.448099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:45.454986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:45.455436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:45.456196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:45.456629 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:45.788123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:45.796238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:45.798330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:45.799790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b6782fc8-0137-47a8-a8c2-06ebd85a4f87 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1342 microversion: 2.20 time: 0.357644 Jun 20 06:22:45.800357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 438/890] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:45 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1342 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:22:46.821443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:46.822048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:46.830239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:46.830730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:46.831612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:46.832119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:47.092008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:47.112809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:47.114459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:47.116889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc758c1f-1064-42d3-be46-de9463edf29e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.299666 Jun 20 06:22:47.116889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 453/891] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:46 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:22:47.281830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-1b3c431a-8ff8-4ef7-88c9-e1df07f64743 req-944fc708-c79d-498e-bdbd-899292aeb557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdad6d85-f1f9-48e6-91e0-88fca110dcb7", "tag": "bb2ca418-d499-4457-99b9-89b22062527b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:47.293935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1b3c431a-8ff8-4ef7-88c9-e1df07f64743 req-944fc708-c79d-498e-bdbd-899292aeb557 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:47.294908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1b3c431a-8ff8-4ef7-88c9-e1df07f64743 req-944fc708-c79d-498e-bdbd-899292aeb557 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:47.315251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-1b3c431a-8ff8-4ef7-88c9-e1df07f64743 req-944fc708-c79d-498e-bdbd-899292aeb557 service nova] Creating event network-changed:bb2ca418-d499-4457-99b9-89b22062527b for instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 on hv-cinder-80473 Jun 20 06:22:47.325180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-1b3c431a-8ff8-4ef7-88c9-e1df07f64743 req-944fc708-c79d-498e-bdbd-899292aeb557 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046643 Jun 20 06:22:47.325829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 439/892] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:47.365139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1878709460", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-388905979", "security_groups": [{"name": "tempest-secgroup-smoke-664575226"}], "networks": [{"uuid": "551ede98-4d04-4b75-be14-b7cb943d9800"}], "block_device_mapping_v2": [{"uuid": "36bcd9fd-41cd-4297-834a-91a6ca61c4b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:47.553186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] validate_networks() for [('551ede98-4d04-4b75-be14-b7cb943d9800', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:22:48.088884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:22:48.089483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:22:48.089799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:22:48.090414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:22:48.090861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:22:48.100054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:48.100493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:48.101280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:48.101743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:48.118726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Getting quotas for project 0346509d863b4c7bb2534206aa76fcd3. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:22:48.122683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Getting quotas for user 571d90a992034d7ea37016cee355a716 and project 0346509d863b4c7bb2534206aa76fcd3. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:22:48.137118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:48.137866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:48.144640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:48.145107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:48.146489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:48.146932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:48.187697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:22:48.189897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36bcd9fd-41cd-4297-834a-91a6ca61c4b5',volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:22:48.293146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:48.306189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:48.308205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:48.309764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e4eb0a34-4656-46a0-b8c8-bea253627144 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.176791 Jun 20 06:22:48.310922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 440/893] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:48 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:22:48.356340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c05d36d5-a3f8-4948-9389-d945b95606ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.996929 Jun 20 06:22:48.357049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 454/894] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:22:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:22:48.367635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-66fd7de5-63df-4295-8e37-86c377f485b8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:48.368349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-66fd7de5-63df-4295-8e37-86c377f485b8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:48.424450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-66fd7de5-63df-4295-8e37-86c377f485b8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:48.433044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-66fd7de5-63df-4295-8e37-86c377f485b8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1088 microversion: 2.1 time: 0.069675 Jun 20 06:22:48.433890 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 441/895] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:49.328730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:49.329403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:49.336984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.337451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.338219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.338652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.450961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ea85c15e-4020-459c-9777-5641266badb1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:49.451714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ea85c15e-4020-459c-9777-5641266badb1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:49.459693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea85c15e-4020-459c-9777-5641266badb1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.460238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea85c15e-4020-459c-9777-5641266badb1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.461032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea85c15e-4020-459c-9777-5641266badb1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.461504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea85c15e-4020-459c-9777-5641266badb1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.471309 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:49.479662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:49.481455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:49.482566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d529fde0-9ede-4696-9023-a7363c76744b tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.158343 Jun 20 06:22:49.483139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 455/896] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:49 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:22:49.524334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ea85c15e-4020-459c-9777-5641266badb1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:49.531826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ea85c15e-4020-459c-9777-5641266badb1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1138 microversion: 2.1 time: 0.084755 Jun 20 06:22:49.532393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 442/897] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:50.500424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:50.500970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:50.509034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:50.509504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:50.510273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:50.510703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:50.548450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-373119b3-6983-4a30-b572-75370b4d94cb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:50.549225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-373119b3-6983-4a30-b572-75370b4d94cb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:50.557063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-373119b3-6983-4a30-b572-75370b4d94cb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:50.557547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-373119b3-6983-4a30-b572-75370b4d94cb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:50.558326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-373119b3-6983-4a30-b572-75370b4d94cb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:50.558768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-373119b3-6983-4a30-b572-75370b4d94cb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:50.681128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-373119b3-6983-4a30-b572-75370b4d94cb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:50.689409 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-373119b3-6983-4a30-b572-75370b4d94cb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1138 microversion: 2.1 time: 0.144572 Jun 20 06:22:50.690297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 443/898] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1138 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:50.735633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:50.744604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:50.746120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:50.747231 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-381ca680-29d7-43f9-bb45-a0bc378a6dcc tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.250884 Jun 20 06:22:50.747780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 456/899] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:50 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:22:51.709235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2aeb7b13-09be-4277-ae90-25348af7fcb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:51.709984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2aeb7b13-09be-4277-ae90-25348af7fcb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:51.717163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2aeb7b13-09be-4277-ae90-25348af7fcb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:51.717650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2aeb7b13-09be-4277-ae90-25348af7fcb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:51.718489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2aeb7b13-09be-4277-ae90-25348af7fcb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:51.718990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2aeb7b13-09be-4277-ae90-25348af7fcb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:51.767769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:51.768631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:51.775753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:51.776195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:51.776968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:51.777402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:51.824058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2aeb7b13-09be-4277-ae90-25348af7fcb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:51.831769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2aeb7b13-09be-4277-ae90-25348af7fcb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1186 microversion: 2.1 time: 0.127566 Jun 20 06:22:51.832327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 444/900] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1186 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:51.945226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:51.953130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:51.954637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:51.955729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d5008842-80af-4f73-b353-2c53a73ba76e tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.191808 Jun 20 06:22:51.956283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 457/901] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:51 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:22:52.853492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1eb662cb-ce3f-44e2-bacd-f25bbbedb9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:52.857273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1eb662cb-ce3f-44e2-bacd-f25bbbedb9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:52.869842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1eb662cb-ce3f-44e2-bacd-f25bbbedb9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:52.870618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1eb662cb-ce3f-44e2-bacd-f25bbbedb9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:52.871609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1eb662cb-ce3f-44e2-bacd-f25bbbedb9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:52.872293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1eb662cb-ce3f-44e2-bacd-f25bbbedb9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:52.960721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-39a00c41-7e15-4ed3-b208-90793706384c req-e8cb6073-cc32-4073-a3e3-cdd807b861e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdad6d85-f1f9-48e6-91e0-88fca110dcb7", "name": "network-vif-plugged", "status": "completed", "tag": "bb2ca418-d499-4457-99b9-89b22062527b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:52.976507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-39a00c41-7e15-4ed3-b208-90793706384c req-e8cb6073-cc32-4073-a3e3-cdd807b861e5 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:52.977453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-39a00c41-7e15-4ed3-b208-90793706384c req-e8cb6073-cc32-4073-a3e3-cdd807b861e5 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:52.990422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-39a00c41-7e15-4ed3-b208-90793706384c req-e8cb6073-cc32-4073-a3e3-cdd807b861e5 service nova] Creating event network-vif-plugged:bb2ca418-d499-4457-99b9-89b22062527b for instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 on hv-cinder-80473 Jun 20 06:22:52.996659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-39a00c41-7e15-4ed3-b208-90793706384c req-e8cb6073-cc32-4073-a3e3-cdd807b861e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160640 Jun 20 06:22:52.997366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 445/902] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:53.009622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:53.010437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:53.019535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:53.020248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:53.021402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:53.021969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:53.197622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1eb662cb-ce3f-44e2-bacd-f25bbbedb9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:53.215623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1eb662cb-ce3f-44e2-bacd-f25bbbedb9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1271 microversion: 2.1 time: 0.363255 Jun 20 06:22:53.229824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 458/903] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1271 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:53.290050 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:53.300960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:53.304255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:53.312414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a0ea8b22-d436-4543-b61d-fa4e59064889 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.309988 Jun 20 06:22:53.313191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 446/904] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:53 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:22:53.955589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-4cd08b7d-efb7-4ce5-bfc8-51c599758a50 req-59cb2ba2-1e8a-4a54-ae20-668afb83933d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0ade09-352b-4eb4-8c02-2bc3e8ed1c19", "tag": "c0a4dc40-28c7-4749-ab81-fe55f9a8c0da"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:53.966784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-4cd08b7d-efb7-4ce5-bfc8-51c599758a50 req-59cb2ba2-1e8a-4a54-ae20-668afb83933d service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:53.967637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-4cd08b7d-efb7-4ce5-bfc8-51c599758a50 req-59cb2ba2-1e8a-4a54-ae20-668afb83933d service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:53.983381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-4cd08b7d-efb7-4ce5-bfc8-51c599758a50 req-59cb2ba2-1e8a-4a54-ae20-668afb83933d service nova] Creating event network-changed:c0a4dc40-28c7-4749-ab81-fe55f9a8c0da for instance df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 on hv-cinder-80473 Jun 20 06:22:53.990792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-4cd08b7d-efb7-4ce5-bfc8-51c599758a50 req-59cb2ba2-1e8a-4a54-ae20-668afb83933d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039376 Jun 20 06:22:53.991513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 459/905] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:54.236082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9ef69755-e123-4f8d-8c1a-4320125fbc91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:54.236682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9ef69755-e123-4f8d-8c1a-4320125fbc91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:54.243419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ef69755-e123-4f8d-8c1a-4320125fbc91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:54.243861 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ef69755-e123-4f8d-8c1a-4320125fbc91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:54.244629 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ef69755-e123-4f8d-8c1a-4320125fbc91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:54.245060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ef69755-e123-4f8d-8c1a-4320125fbc91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:54.259988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:54.336611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:54.337320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:54.343662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:54.344116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:54.344892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:54.345329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:54.406927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9ef69755-e123-4f8d-8c1a-4320125fbc91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:54.415683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9ef69755-e123-4f8d-8c1a-4320125fbc91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.183439 Jun 20 06:22:54.416375 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 447/906] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:54.508764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:54.516836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:54.518614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:54.519714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4a6b9f83-b682-476c-8b9d-de5f0ef01c90 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.188404 Jun 20 06:22:54.520837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 460/907] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:54 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:22:55.432488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-939f8567-1105-42d5-ac99-1891d7ed4bb0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:55.433101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-939f8567-1105-42d5-ac99-1891d7ed4bb0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:55.440077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-939f8567-1105-42d5-ac99-1891d7ed4bb0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:55.440531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-939f8567-1105-42d5-ac99-1891d7ed4bb0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:55.441302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-939f8567-1105-42d5-ac99-1891d7ed4bb0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:55.442281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-939f8567-1105-42d5-ac99-1891d7ed4bb0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:55.538326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:55.538932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:55.545706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:55.546164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:55.546946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:55.547381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:55.578749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-939f8567-1105-42d5-ac99-1891d7ed4bb0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:55.587238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-939f8567-1105-42d5-ac99-1891d7ed4bb0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.158453 Jun 20 06:22:55.587731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 448/908] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:55.675556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:55.684185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:55.685713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:55.686819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f27b6688-7cc1-474e-ba14-4bd45f1dd1be tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.152392 Jun 20 06:22:55.687381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 461/909] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:55 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:22:56.604159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-87edd83b-776b-462c-bcf1-da0aa20c55ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:56.604709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-87edd83b-776b-462c-bcf1-da0aa20c55ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:56.611599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87edd83b-776b-462c-bcf1-da0aa20c55ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:56.612047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87edd83b-776b-462c-bcf1-da0aa20c55ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:56.612820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87edd83b-776b-462c-bcf1-da0aa20c55ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:56.613259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87edd83b-776b-462c-bcf1-da0aa20c55ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:56.633565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:56.711250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:56.712242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:56.721603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:56.722461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:56.724451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:56.725520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:56.731902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:56.752972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-87edd83b-776b-462c-bcf1-da0aa20c55ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:56.761938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-87edd83b-776b-462c-bcf1-da0aa20c55ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.161623 Jun 20 06:22:56.762521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 449/910] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:56.880148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:56.888499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:56.890043 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:56.891145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5182d816-4e93-4ca2-8b62-69438eb1d8c2 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.187435 Jun 20 06:22:56.891696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 462/911] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:56 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:22:57.784031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5f181d75-dd31-4689-b05c-fc5e656248f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:57.784717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5f181d75-dd31-4689-b05c-fc5e656248f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:57.791532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f181d75-dd31-4689-b05c-fc5e656248f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:57.791987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f181d75-dd31-4689-b05c-fc5e656248f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:57.792763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f181d75-dd31-4689-b05c-fc5e656248f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:57.793204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f181d75-dd31-4689-b05c-fc5e656248f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:57.909890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:57.910552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:57.917430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:57.917960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:57.918746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:57.919185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:57.931636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5f181d75-dd31-4689-b05c-fc5e656248f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:57.940830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5f181d75-dd31-4689-b05c-fc5e656248f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.160581 Jun 20 06:22:57.941416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 450/912] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:58.054657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:58.062521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:58.064004 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:58.065097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0a82e05f-a9b2-4c78-a780-5a221aed9546 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.159112 Jun 20 06:22:58.065687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 463/913] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:57 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:22:58.961133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0fd61ab8-89ab-47c5-b5fa-ec25b712b1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:58.961969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0fd61ab8-89ab-47c5-b5fa-ec25b712b1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:58.964789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=12 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:58.986831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fd61ab8-89ab-47c5-b5fa-ec25b712b1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:58.987292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fd61ab8-89ab-47c5-b5fa-ec25b712b1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:58.988285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fd61ab8-89ab-47c5-b5fa-ec25b712b1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:58.989409 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fd61ab8-89ab-47c5-b5fa-ec25b712b1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:59.084408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:59.085006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:59.088038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:59.088689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=8 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:59.094124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:59.094573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:59.095346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:59.095773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:59.474337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0fd61ab8-89ab-47c5-b5fa-ec25b712b1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:59.481996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0fd61ab8-89ab-47c5-b5fa-ec25b712b1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.526607 Jun 20 06:22:59.482574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 451/914] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:59.530330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:59.538138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:59.539625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:59.540716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-080864fe-b39e-4293-b747-a9eae5f09080 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1407 microversion: 2.20 time: 0.460523 Jun 20 06:22:59.541266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 464/915] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:22:59 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:23:00.499338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9cfeeb31-3843-43d5-bc03-f03a907d7e08 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:00.499935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9cfeeb31-3843-43d5-bc03-f03a907d7e08 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:00.506412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cfeeb31-3843-43d5-bc03-f03a907d7e08 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:00.506863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cfeeb31-3843-43d5-bc03-f03a907d7e08 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:00.507634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cfeeb31-3843-43d5-bc03-f03a907d7e08 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:00.508071 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cfeeb31-3843-43d5-bc03-f03a907d7e08 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:00.558387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:00.558994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:00.565587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:00.565958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:00.567310 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:00.567863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:00.666971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9cfeeb31-3843-43d5-bc03-f03a907d7e08 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:00.675261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9cfeeb31-3843-43d5-bc03-f03a907d7e08 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.179664 Jun 20 06:23:00.676024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 452/916] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:00.848856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:00.857340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:00.858868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:00.860029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-881cdceb-d627-4fe4-bc7f-7da3c45f7638 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1600 microversion: 2.20 time: 0.305494 Jun 20 06:23:00.860589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 465/917] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:23:00 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1600 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:23:00.877905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f33c1d7c-2804-4dfe-81c5-19b8db285e76 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:00.878393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f33c1d7c-2804-4dfe-81c5-19b8db285e76 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:00.884704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f33c1d7c-2804-4dfe-81c5-19b8db285e76 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:00.885147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f33c1d7c-2804-4dfe-81c5-19b8db285e76 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:00.885943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f33c1d7c-2804-4dfe-81c5-19b8db285e76 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:00.886376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f33c1d7c-2804-4dfe-81c5-19b8db285e76 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:00.964981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f33c1d7c-2804-4dfe-81c5-19b8db285e76 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090864 Jun 20 06:23:00.965604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 453/918] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Jun 20 06:23:00 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:23:01.693219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8b216cf5-2fb8-4fc4-916f-be526084c8b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:01.693834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8b216cf5-2fb8-4fc4-916f-be526084c8b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:01.700370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b216cf5-2fb8-4fc4-916f-be526084c8b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:01.700803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b216cf5-2fb8-4fc4-916f-be526084c8b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:01.701603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b216cf5-2fb8-4fc4-916f-be526084c8b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:01.702040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b216cf5-2fb8-4fc4-916f-be526084c8b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:01.911116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8b216cf5-2fb8-4fc4-916f-be526084c8b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:01.918782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8b216cf5-2fb8-4fc4-916f-be526084c8b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.230008 Jun 20 06:23:01.919352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 466/919] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:02.053088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-ea6bca7f-b017-4a50-b9d6-55f25ac71b80 req-53b92e90-b8b6-428e-9fbd-1d337a29c919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdad6d85-f1f9-48e6-91e0-88fca110dcb7", "tag": "bb2ca418-d499-4457-99b9-89b22062527b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:23:02.061367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ea6bca7f-b017-4a50-b9d6-55f25ac71b80 req-53b92e90-b8b6-428e-9fbd-1d337a29c919 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:02.061790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ea6bca7f-b017-4a50-b9d6-55f25ac71b80 req-53b92e90-b8b6-428e-9fbd-1d337a29c919 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:02.073052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-ea6bca7f-b017-4a50-b9d6-55f25ac71b80 req-53b92e90-b8b6-428e-9fbd-1d337a29c919 service nova] Creating event network-changed:bb2ca418-d499-4457-99b9-89b22062527b for instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 on hv-cinder-80473 Jun 20 06:23:02.078567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-ea6bca7f-b017-4a50-b9d6-55f25ac71b80 req-53b92e90-b8b6-428e-9fbd-1d337a29c919 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030327 Jun 20 06:23:02.079177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 454/920] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:23:02.936073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4c9e3878-4e2c-43c9-a718-7faa511a72b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:02.936697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4c9e3878-4e2c-43c9-a718-7faa511a72b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:02.943827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c9e3878-4e2c-43c9-a718-7faa511a72b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:02.944270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c9e3878-4e2c-43c9-a718-7faa511a72b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:02.945026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c9e3878-4e2c-43c9-a718-7faa511a72b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:02.945490 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c9e3878-4e2c-43c9-a718-7faa511a72b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:03.087220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4c9e3878-4e2c-43c9-a718-7faa511a72b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:03.094696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4c9e3878-4e2c-43c9-a718-7faa511a72b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.162436 Jun 20 06:23:03.095260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 467/921] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:04.113818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c2abdd1-b7bf-45c1-8d47-471b3a33d223 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:04.114536 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c2abdd1-b7bf-45c1-8d47-471b3a33d223 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:04.121147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c2abdd1-b7bf-45c1-8d47-471b3a33d223 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:04.121642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c2abdd1-b7bf-45c1-8d47-471b3a33d223 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:04.122425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c2abdd1-b7bf-45c1-8d47-471b3a33d223 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:04.122868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c2abdd1-b7bf-45c1-8d47-471b3a33d223 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:04.261456 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c2abdd1-b7bf-45c1-8d47-471b3a33d223 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:04.269046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c2abdd1-b7bf-45c1-8d47-471b3a33d223 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.160526 Jun 20 06:23:04.270152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 455/922] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:05.286225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-26df6649-e6ff-4dfa-b42a-27fccbb87d11 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:05.286831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-26df6649-e6ff-4dfa-b42a-27fccbb87d11 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:05.289347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:05.294752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26df6649-e6ff-4dfa-b42a-27fccbb87d11 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:05.295197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26df6649-e6ff-4dfa-b42a-27fccbb87d11 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:05.295960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26df6649-e6ff-4dfa-b42a-27fccbb87d11 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:05.296425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26df6649-e6ff-4dfa-b42a-27fccbb87d11 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:05.443367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-26df6649-e6ff-4dfa-b42a-27fccbb87d11 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:05.450921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-26df6649-e6ff-4dfa-b42a-27fccbb87d11 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.168734 Jun 20 06:23:05.451498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 468/923] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:06.467903 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-882fdb28-8074-4c77-a47a-e466fd5dfe5e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:06.468495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-882fdb28-8074-4c77-a47a-e466fd5dfe5e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:06.471108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:06.478982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-882fdb28-8074-4c77-a47a-e466fd5dfe5e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:06.479783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-882fdb28-8074-4c77-a47a-e466fd5dfe5e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:06.481304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-882fdb28-8074-4c77-a47a-e466fd5dfe5e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:06.482119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-882fdb28-8074-4c77-a47a-e466fd5dfe5e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:06.630219 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-882fdb28-8074-4c77-a47a-e466fd5dfe5e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:06.638728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-882fdb28-8074-4c77-a47a-e466fd5dfe5e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.174714 Jun 20 06:23:06.639337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 456/924] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:07.655982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2e8dbf7d-3b0f-4fc8-bdf8-7498a1982864 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:07.656600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2e8dbf7d-3b0f-4fc8-bdf8-7498a1982864 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:07.663492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e8dbf7d-3b0f-4fc8-bdf8-7498a1982864 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:07.663942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e8dbf7d-3b0f-4fc8-bdf8-7498a1982864 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:07.664704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e8dbf7d-3b0f-4fc8-bdf8-7498a1982864 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:07.665138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e8dbf7d-3b0f-4fc8-bdf8-7498a1982864 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:07.797044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2e8dbf7d-3b0f-4fc8-bdf8-7498a1982864 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:07.805101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2e8dbf7d-3b0f-4fc8-bdf8-7498a1982864 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.152962 Jun 20 06:23:07.805704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 469/925] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:08.822521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f0c5f1f-ee05-48b7-8531-3a081c3890bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:08.823082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f0c5f1f-ee05-48b7-8531-3a081c3890bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:08.829824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f0c5f1f-ee05-48b7-8531-3a081c3890bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:08.830297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f0c5f1f-ee05-48b7-8531-3a081c3890bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:08.831055 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f0c5f1f-ee05-48b7-8531-3a081c3890bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:08.831488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f0c5f1f-ee05-48b7-8531-3a081c3890bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:08.960258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f0c5f1f-ee05-48b7-8531-3a081c3890bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:08.967587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f0c5f1f-ee05-48b7-8531-3a081c3890bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.148946 Jun 20 06:23:08.968149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 457/926] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:09.984356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e86cd0c2-74c5-49b0-9a7b-f273dbc5dec4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:09.984970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e86cd0c2-74c5-49b0-9a7b-f273dbc5dec4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:09.992342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e86cd0c2-74c5-49b0-9a7b-f273dbc5dec4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:09.992788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e86cd0c2-74c5-49b0-9a7b-f273dbc5dec4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:09.993573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e86cd0c2-74c5-49b0-9a7b-f273dbc5dec4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:09.994011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e86cd0c2-74c5-49b0-9a7b-f273dbc5dec4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:10.131449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e86cd0c2-74c5-49b0-9a7b-f273dbc5dec4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:10.138822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e86cd0c2-74c5-49b0-9a7b-f273dbc5dec4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.158341 Jun 20 06:23:10.139384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 470/927] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:11.155533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-56d26e2c-b09d-44eb-9de5-2c59588aaaec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:11.156144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-56d26e2c-b09d-44eb-9de5-2c59588aaaec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:11.163382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56d26e2c-b09d-44eb-9de5-2c59588aaaec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:11.163828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56d26e2c-b09d-44eb-9de5-2c59588aaaec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:11.164582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56d26e2c-b09d-44eb-9de5-2c59588aaaec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:11.165011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56d26e2c-b09d-44eb-9de5-2c59588aaaec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:11.299335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-56d26e2c-b09d-44eb-9de5-2c59588aaaec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:11.307316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-56d26e2c-b09d-44eb-9de5-2c59588aaaec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.155646 Jun 20 06:23:11.307869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 458/928] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:12.324009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2e1bb6c5-b723-43f2-a2cc-7263509bffde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:12.324559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2e1bb6c5-b723-43f2-a2cc-7263509bffde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:12.331312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e1bb6c5-b723-43f2-a2cc-7263509bffde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:12.331545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e1bb6c5-b723-43f2-a2cc-7263509bffde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:12.332877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e1bb6c5-b723-43f2-a2cc-7263509bffde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:12.333292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e1bb6c5-b723-43f2-a2cc-7263509bffde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:12.465306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2e1bb6c5-b723-43f2-a2cc-7263509bffde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:12.473439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2e1bb6c5-b723-43f2-a2cc-7263509bffde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.152605 Jun 20 06:23:12.474216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 471/929] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:13.492893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-499494fd-552b-4c82-84ea-6948d803e454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:13.493442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-499494fd-552b-4c82-84ea-6948d803e454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:13.499818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-499494fd-552b-4c82-84ea-6948d803e454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:13.500263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-499494fd-552b-4c82-84ea-6948d803e454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:13.501019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-499494fd-552b-4c82-84ea-6948d803e454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:13.501544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-499494fd-552b-4c82-84ea-6948d803e454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:13.633755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-499494fd-552b-4c82-84ea-6948d803e454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:13.641254 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-499494fd-552b-4c82-84ea-6948d803e454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.153013 Jun 20 06:23:13.641842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 459/930] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:14.658835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1ba1d62a-f8d6-43b7-a910-cca7bb39ca51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:14.659544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1ba1d62a-f8d6-43b7-a910-cca7bb39ca51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:14.666042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ba1d62a-f8d6-43b7-a910-cca7bb39ca51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:14.666479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ba1d62a-f8d6-43b7-a910-cca7bb39ca51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:14.667224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ba1d62a-f8d6-43b7-a910-cca7bb39ca51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:14.667651 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ba1d62a-f8d6-43b7-a910-cca7bb39ca51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:14.798918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1ba1d62a-f8d6-43b7-a910-cca7bb39ca51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:14.806959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1ba1d62a-f8d6-43b7-a910-cca7bb39ca51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.152006 Jun 20 06:23:14.807510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 472/931] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:15.823994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0acb1d1e-15d7-4cb1-94b3-e32119091da9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:15.824606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0acb1d1e-15d7-4cb1-94b3-e32119091da9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:15.830702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0acb1d1e-15d7-4cb1-94b3-e32119091da9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:15.831152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0acb1d1e-15d7-4cb1-94b3-e32119091da9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:15.832497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0acb1d1e-15d7-4cb1-94b3-e32119091da9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:15.832934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0acb1d1e-15d7-4cb1-94b3-e32119091da9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:15.968194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0acb1d1e-15d7-4cb1-94b3-e32119091da9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:15.975962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0acb1d1e-15d7-4cb1-94b3-e32119091da9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.156007 Jun 20 06:23:15.976516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 460/932] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:15 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:16.993868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9a8aa59d-92e7-4004-bfd8-b2066b26b824 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:16.994503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9a8aa59d-92e7-4004-bfd8-b2066b26b824 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:17.000828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a8aa59d-92e7-4004-bfd8-b2066b26b824 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:17.001291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a8aa59d-92e7-4004-bfd8-b2066b26b824 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:17.002066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a8aa59d-92e7-4004-bfd8-b2066b26b824 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:17.002491 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a8aa59d-92e7-4004-bfd8-b2066b26b824 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:17.132511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a8aa59d-92e7-4004-bfd8-b2066b26b824 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:17.139877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9a8aa59d-92e7-4004-bfd8-b2066b26b824 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.149826 Jun 20 06:23:17.140427 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 473/933] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:18.157045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b91a6ae-693b-4b2c-99b7-4d4dc00fd1c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:18.157677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2b91a6ae-693b-4b2c-99b7-4d4dc00fd1c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:18.164767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b91a6ae-693b-4b2c-99b7-4d4dc00fd1c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:18.165214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b91a6ae-693b-4b2c-99b7-4d4dc00fd1c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:18.166015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b91a6ae-693b-4b2c-99b7-4d4dc00fd1c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:18.166449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b91a6ae-693b-4b2c-99b7-4d4dc00fd1c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:18.298706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b91a6ae-693b-4b2c-99b7-4d4dc00fd1c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:18.306206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2b91a6ae-693b-4b2c-99b7-4d4dc00fd1c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.153038 Jun 20 06:23:18.306927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 461/934] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:19.322480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2eb975dd-9314-40ab-adc6-a04fb64b841f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:19.323202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2eb975dd-9314-40ab-adc6-a04fb64b841f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:19.329639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2eb975dd-9314-40ab-adc6-a04fb64b841f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:19.330083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2eb975dd-9314-40ab-adc6-a04fb64b841f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:19.330843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2eb975dd-9314-40ab-adc6-a04fb64b841f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:19.331748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2eb975dd-9314-40ab-adc6-a04fb64b841f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:19.460056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2eb975dd-9314-40ab-adc6-a04fb64b841f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:19.467472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2eb975dd-9314-40ab-adc6-a04fb64b841f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.148897 Jun 20 06:23:19.468015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 474/935] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:20.484094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-78f075e0-1f47-4a11-9569-6f55e0333c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:20.484713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-78f075e0-1f47-4a11-9569-6f55e0333c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:20.492888 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78f075e0-1f47-4a11-9569-6f55e0333c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:20.493617 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78f075e0-1f47-4a11-9569-6f55e0333c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:20.494406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78f075e0-1f47-4a11-9569-6f55e0333c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:20.494843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78f075e0-1f47-4a11-9569-6f55e0333c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:20.632952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-78f075e0-1f47-4a11-9569-6f55e0333c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:20.640574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-78f075e0-1f47-4a11-9569-6f55e0333c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.160424 Jun 20 06:23:20.641408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 462/936] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:21.657967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9dde7574-c3db-459d-8e5f-59db90104781 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:21.658572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9dde7574-c3db-459d-8e5f-59db90104781 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:21.665215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9dde7574-c3db-459d-8e5f-59db90104781 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:21.665683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9dde7574-c3db-459d-8e5f-59db90104781 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:21.666435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9dde7574-c3db-459d-8e5f-59db90104781 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:21.666865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9dde7574-c3db-459d-8e5f-59db90104781 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:21.798362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9dde7574-c3db-459d-8e5f-59db90104781 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:21.805879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9dde7574-c3db-459d-8e5f-59db90104781 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.151747 Jun 20 06:23:21.806423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 475/937] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:22.823044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a9ec4279-b6b7-43d3-ba2b-3d20d473c5f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:22.823650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a9ec4279-b6b7-43d3-ba2b-3d20d473c5f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:22.830199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9ec4279-b6b7-43d3-ba2b-3d20d473c5f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:22.830649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9ec4279-b6b7-43d3-ba2b-3d20d473c5f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:22.831417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9ec4279-b6b7-43d3-ba2b-3d20d473c5f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:22.831854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9ec4279-b6b7-43d3-ba2b-3d20d473c5f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:22.962767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a9ec4279-b6b7-43d3-ba2b-3d20d473c5f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:22.970249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a9ec4279-b6b7-43d3-ba2b-3d20d473c5f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.150981 Jun 20 06:23:22.970810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 463/938] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:22 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:23.987446 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-898e8097-ac84-4547-9ff2-901768588dac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:23.988107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-898e8097-ac84-4547-9ff2-901768588dac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:23.995184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-898e8097-ac84-4547-9ff2-901768588dac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:23.995630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-898e8097-ac84-4547-9ff2-901768588dac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:23.996414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-898e8097-ac84-4547-9ff2-901768588dac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:23.996841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-898e8097-ac84-4547-9ff2-901768588dac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:24.126981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-898e8097-ac84-4547-9ff2-901768588dac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:24.134417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-898e8097-ac84-4547-9ff2-901768588dac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.150782 Jun 20 06:23:24.134971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 476/939] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:25.151369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3b75a1ac-7e86-4042-88b0-3081d84ab46a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:25.151985 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3b75a1ac-7e86-4042-88b0-3081d84ab46a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:25.158483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b75a1ac-7e86-4042-88b0-3081d84ab46a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:25.158941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b75a1ac-7e86-4042-88b0-3081d84ab46a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:25.159699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b75a1ac-7e86-4042-88b0-3081d84ab46a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:25.160142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b75a1ac-7e86-4042-88b0-3081d84ab46a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:25.290920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b75a1ac-7e86-4042-88b0-3081d84ab46a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:25.298507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3b75a1ac-7e86-4042-88b0-3081d84ab46a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.150949 Jun 20 06:23:25.299077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 464/940] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:25 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:26.315784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8695fed8-c46d-407a-9c3f-2603fc5e1910 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:26.316309 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8695fed8-c46d-407a-9c3f-2603fc5e1910 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:26.322839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8695fed8-c46d-407a-9c3f-2603fc5e1910 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:26.323577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8695fed8-c46d-407a-9c3f-2603fc5e1910 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:26.324030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8695fed8-c46d-407a-9c3f-2603fc5e1910 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:26.324465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8695fed8-c46d-407a-9c3f-2603fc5e1910 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:26.461997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8695fed8-c46d-407a-9c3f-2603fc5e1910 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:26.469342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8695fed8-c46d-407a-9c3f-2603fc5e1910 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.157530 Jun 20 06:23:26.469940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 477/941] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:27.486769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-84665ae0-0bb8-4ad0-a146-e47bed5e0f2d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:27.487385 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-84665ae0-0bb8-4ad0-a146-e47bed5e0f2d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:27.494742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84665ae0-0bb8-4ad0-a146-e47bed5e0f2d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:27.495196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84665ae0-0bb8-4ad0-a146-e47bed5e0f2d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:27.495965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84665ae0-0bb8-4ad0-a146-e47bed5e0f2d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:27.496406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84665ae0-0bb8-4ad0-a146-e47bed5e0f2d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:27.500360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=87 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:27.631336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84665ae0-0bb8-4ad0-a146-e47bed5e0f2d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:27.638773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-84665ae0-0bb8-4ad0-a146-e47bed5e0f2d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.155941 Jun 20 06:23:27.639325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 465/942] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:27 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:28.655875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e4bbd504-f005-481d-9ae4-ddb02d20c24e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:28.656483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e4bbd504-f005-481d-9ae4-ddb02d20c24e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:28.662860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4bbd504-f005-481d-9ae4-ddb02d20c24e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:28.663318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4bbd504-f005-481d-9ae4-ddb02d20c24e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:28.664065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4bbd504-f005-481d-9ae4-ddb02d20c24e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:28.664502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4bbd504-f005-481d-9ae4-ddb02d20c24e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:28.668315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=95 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:28.792543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e4bbd504-f005-481d-9ae4-ddb02d20c24e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:28.799891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e4bbd504-f005-481d-9ae4-ddb02d20c24e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.147911 Jun 20 06:23:28.800451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 478/943] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:28 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:29.816813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aef99a24-a5a4-4e87-afef-e093816d6d79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:29.818153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aef99a24-a5a4-4e87-afef-e093816d6d79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:29.824591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aef99a24-a5a4-4e87-afef-e093816d6d79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:29.825045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aef99a24-a5a4-4e87-afef-e093816d6d79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:29.825851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aef99a24-a5a4-4e87-afef-e093816d6d79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:29.826291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aef99a24-a5a4-4e87-afef-e093816d6d79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:29.962698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-aef99a24-a5a4-4e87-afef-e093816d6d79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:29.970015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aef99a24-a5a4-4e87-afef-e093816d6d79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.157098 Jun 20 06:23:29.970574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 466/944] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:30.986877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3fc673a3-a1ad-4f9c-a4a6-106e6449286d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:30.987484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3fc673a3-a1ad-4f9c-a4a6-106e6449286d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:30.993978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3fc673a3-a1ad-4f9c-a4a6-106e6449286d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:30.994428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3fc673a3-a1ad-4f9c-a4a6-106e6449286d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:30.995186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3fc673a3-a1ad-4f9c-a4a6-106e6449286d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:30.995621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3fc673a3-a1ad-4f9c-a4a6-106e6449286d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:31.123849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3fc673a3-a1ad-4f9c-a4a6-106e6449286d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:31.131183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3fc673a3-a1ad-4f9c-a4a6-106e6449286d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.148151 Jun 20 06:23:31.131734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 479/945] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:32.148342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dc158cc4-e495-4479-9f5c-90444e05c1c2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:32.148956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dc158cc4-e495-4479-9f5c-90444e05c1c2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:32.155425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc158cc4-e495-4479-9f5c-90444e05c1c2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:32.155875 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc158cc4-e495-4479-9f5c-90444e05c1c2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:32.156635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc158cc4-e495-4479-9f5c-90444e05c1c2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:32.157073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc158cc4-e495-4479-9f5c-90444e05c1c2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:32.288527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc158cc4-e495-4479-9f5c-90444e05c1c2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:32.295978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dc158cc4-e495-4479-9f5c-90444e05c1c2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.152059 Jun 20 06:23:32.296535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 467/946] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:32 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:33.312031 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8de394c2-b280-42e5-82c4-9458982fbcda tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:33.312641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8de394c2-b280-42e5-82c4-9458982fbcda tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:33.319669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8de394c2-b280-42e5-82c4-9458982fbcda tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:33.320119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8de394c2-b280-42e5-82c4-9458982fbcda tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:33.320903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8de394c2-b280-42e5-82c4-9458982fbcda tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:33.321331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8de394c2-b280-42e5-82c4-9458982fbcda tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:33.450923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8de394c2-b280-42e5-82c4-9458982fbcda tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:33.458764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8de394c2-b280-42e5-82c4-9458982fbcda tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.150470 Jun 20 06:23:33.459606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 480/947] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:33 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:34.476347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d1b5726f-99c7-49f5-a627-d24f2c649e27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:34.476986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d1b5726f-99c7-49f5-a627-d24f2c649e27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:34.483562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1b5726f-99c7-49f5-a627-d24f2c649e27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:34.484016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1b5726f-99c7-49f5-a627-d24f2c649e27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:34.484818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1b5726f-99c7-49f5-a627-d24f2c649e27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:34.485260 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1b5726f-99c7-49f5-a627-d24f2c649e27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:34.614514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d1b5726f-99c7-49f5-a627-d24f2c649e27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:34.622439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d1b5726f-99c7-49f5-a627-d24f2c649e27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.150507 Jun 20 06:23:34.622990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 468/948] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:35.640010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d605ffdf-ed10-4fbe-8050-a87214586a79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:35.640617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d605ffdf-ed10-4fbe-8050-a87214586a79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:35.643192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:35.648849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d605ffdf-ed10-4fbe-8050-a87214586a79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:35.649406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d605ffdf-ed10-4fbe-8050-a87214586a79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:35.650166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d605ffdf-ed10-4fbe-8050-a87214586a79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:35.650597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d605ffdf-ed10-4fbe-8050-a87214586a79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:35.781721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d605ffdf-ed10-4fbe-8050-a87214586a79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:35.789729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d605ffdf-ed10-4fbe-8050-a87214586a79 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.153530 Jun 20 06:23:35.790282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 481/949] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:35 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:36.806400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-64bf9e5c-4aaf-45d4-97ec-b82233251193 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:36.807015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-64bf9e5c-4aaf-45d4-97ec-b82233251193 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:36.809330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:36.814689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64bf9e5c-4aaf-45d4-97ec-b82233251193 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:36.815142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64bf9e5c-4aaf-45d4-97ec-b82233251193 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:36.815910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64bf9e5c-4aaf-45d4-97ec-b82233251193 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:36.816354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-64bf9e5c-4aaf-45d4-97ec-b82233251193 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:36.946914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-64bf9e5c-4aaf-45d4-97ec-b82233251193 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:36.954256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-64bf9e5c-4aaf-45d4-97ec-b82233251193 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.151697 Jun 20 06:23:36.954814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 469/950] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:37.970305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5141a420-fb9b-4faf-934c-0fcc713c383d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:37.970940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5141a420-fb9b-4faf-934c-0fcc713c383d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:37.978006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5141a420-fb9b-4faf-934c-0fcc713c383d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:37.978452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5141a420-fb9b-4faf-934c-0fcc713c383d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:37.979212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5141a420-fb9b-4faf-934c-0fcc713c383d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:37.979650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5141a420-fb9b-4faf-934c-0fcc713c383d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:38.110116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5141a420-fb9b-4faf-934c-0fcc713c383d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:38.117473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5141a420-fb9b-4faf-934c-0fcc713c383d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.151079 Jun 20 06:23:38.118028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 482/951] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:39.133820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f99e7b56-6d5b-4ca6-b957-30d0f7a9e603 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:39.134441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f99e7b56-6d5b-4ca6-b957-30d0f7a9e603 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:39.140943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f99e7b56-6d5b-4ca6-b957-30d0f7a9e603 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:39.141414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f99e7b56-6d5b-4ca6-b957-30d0f7a9e603 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:39.142190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f99e7b56-6d5b-4ca6-b957-30d0f7a9e603 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:39.142878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f99e7b56-6d5b-4ca6-b957-30d0f7a9e603 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:39.277349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f99e7b56-6d5b-4ca6-b957-30d0f7a9e603 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:39.284820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f99e7b56-6d5b-4ca6-b957-30d0f7a9e603 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.155026 Jun 20 06:23:39.285391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 470/952] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:39 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:40.301353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b3b0b87d-a3c7-46aa-809d-7e43d56e20c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:40.302069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b3b0b87d-a3c7-46aa-809d-7e43d56e20c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:40.308407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3b0b87d-a3c7-46aa-809d-7e43d56e20c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:40.308857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3b0b87d-a3c7-46aa-809d-7e43d56e20c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:40.309679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3b0b87d-a3c7-46aa-809d-7e43d56e20c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:40.310126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3b0b87d-a3c7-46aa-809d-7e43d56e20c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:40.443651 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b3b0b87d-a3c7-46aa-809d-7e43d56e20c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:40.451173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b3b0b87d-a3c7-46aa-809d-7e43d56e20c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.153658 Jun 20 06:23:40.451726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 483/953] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:41.468790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-99e38d61-671c-4090-9933-665df8a820fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:41.469577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-99e38d61-671c-4090-9933-665df8a820fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:41.477124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99e38d61-671c-4090-9933-665df8a820fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:41.477592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99e38d61-671c-4090-9933-665df8a820fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:41.478353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99e38d61-671c-4090-9933-665df8a820fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:41.478797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99e38d61-671c-4090-9933-665df8a820fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:41.605359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-99e38d61-671c-4090-9933-665df8a820fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:41.612635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-99e38d61-671c-4090-9933-665df8a820fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.148145 Jun 20 06:23:41.613258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 471/954] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:42.630620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0c93bd28-9398-4835-9da0-d9477814f371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:42.631301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0c93bd28-9398-4835-9da0-d9477814f371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:42.638008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c93bd28-9398-4835-9da0-d9477814f371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:42.638455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c93bd28-9398-4835-9da0-d9477814f371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:42.639281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c93bd28-9398-4835-9da0-d9477814f371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:42.639758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c93bd28-9398-4835-9da0-d9477814f371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:42.772489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0c93bd28-9398-4835-9da0-d9477814f371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:42.782535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0c93bd28-9398-4835-9da0-d9477814f371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.156391 Jun 20 06:23:42.783100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 484/955] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:42 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:43.799442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ea1e49a6-1031-4b9b-ab68-8aec2d40ab1c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:43.800085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ea1e49a6-1031-4b9b-ab68-8aec2d40ab1c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:43.807036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea1e49a6-1031-4b9b-ab68-8aec2d40ab1c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:43.807486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea1e49a6-1031-4b9b-ab68-8aec2d40ab1c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:43.808255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea1e49a6-1031-4b9b-ab68-8aec2d40ab1c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:43.808696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea1e49a6-1031-4b9b-ab68-8aec2d40ab1c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:43.941934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ea1e49a6-1031-4b9b-ab68-8aec2d40ab1c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:43.949771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ea1e49a6-1031-4b9b-ab68-8aec2d40ab1c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.154185 Jun 20 06:23:43.950331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 472/956] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:44.966699 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1a8fb092-a4dc-4721-9c53-5f2c9d5419e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:44.967305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1a8fb092-a4dc-4721-9c53-5f2c9d5419e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:44.973832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a8fb092-a4dc-4721-9c53-5f2c9d5419e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:44.974275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a8fb092-a4dc-4721-9c53-5f2c9d5419e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:44.975032 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a8fb092-a4dc-4721-9c53-5f2c9d5419e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:44.975461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a8fb092-a4dc-4721-9c53-5f2c9d5419e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:45.104926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1a8fb092-a4dc-4721-9c53-5f2c9d5419e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:45.112398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1a8fb092-a4dc-4721-9c53-5f2c9d5419e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.149600 Jun 20 06:23:45.112946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 485/957] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:46.129696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-58c56ef5-9d27-4c42-afe7-55224e00ea25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:46.130335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-58c56ef5-9d27-4c42-afe7-55224e00ea25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:46.136919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58c56ef5-9d27-4c42-afe7-55224e00ea25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:46.137361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58c56ef5-9d27-4c42-afe7-55224e00ea25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:46.138133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58c56ef5-9d27-4c42-afe7-55224e00ea25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:46.138567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58c56ef5-9d27-4c42-afe7-55224e00ea25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:46.269026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-58c56ef5-9d27-4c42-afe7-55224e00ea25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:46.276978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-58c56ef5-9d27-4c42-afe7-55224e00ea25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.151358 Jun 20 06:23:46.277557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 473/958] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:47.294513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-449cb6c9-5425-47f5-b944-dbd6bb01a932 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:47.295124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-449cb6c9-5425-47f5-b944-dbd6bb01a932 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:47.301674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-449cb6c9-5425-47f5-b944-dbd6bb01a932 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:47.302120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-449cb6c9-5425-47f5-b944-dbd6bb01a932 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:47.302875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-449cb6c9-5425-47f5-b944-dbd6bb01a932 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:47.303305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-449cb6c9-5425-47f5-b944-dbd6bb01a932 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:47.535464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-449cb6c9-5425-47f5-b944-dbd6bb01a932 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:47.543558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-449cb6c9-5425-47f5-b944-dbd6bb01a932 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.253592 Jun 20 06:23:47.544205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 486/959] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:48.473260 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40628875-4d31-4fb3-a324-7f6e374a5901 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:48.473780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40628875-4d31-4fb3-a324-7f6e374a5901 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:48.483268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-6d31c89c-11be-4944-9c8d-a5185a3183e8 req-a8d3b8f1-2039-42af-b5c2-4bb25b86187c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabdd9ee-515b-492e-82b7-aae14f44c6fb", "tag": "4328b13c-3245-46f3-b4dd-7636eaa4cd6f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:23:48.492230 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40628875-4d31-4fb3-a324-7f6e374a5901 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.492652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40628875-4d31-4fb3-a324-7f6e374a5901 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.492938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-6d31c89c-11be-4944-9c8d-a5185a3183e8 req-a8d3b8f1-2039-42af-b5c2-4bb25b86187c service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.493416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-6d31c89c-11be-4944-9c8d-a5185a3183e8 req-a8d3b8f1-2039-42af-b5c2-4bb25b86187c service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.494029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40628875-4d31-4fb3-a324-7f6e374a5901 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.494630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40628875-4d31-4fb3-a324-7f6e374a5901 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.508224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-6d31c89c-11be-4944-9c8d-a5185a3183e8 req-a8d3b8f1-2039-42af-b5c2-4bb25b86187c service nova] Creating event network-changed:4328b13c-3245-46f3-b4dd-7636eaa4cd6f for instance cabdd9ee-515b-492e-82b7-aae14f44c6fb on hv-cinder-80473 Jun 20 06:23:48.512519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-6d31c89c-11be-4944-9c8d-a5185a3183e8 req-a8d3b8f1-2039-42af-b5c2-4bb25b86187c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033919 Jun 20 06:23:48.513289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 487/960] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:23:48.527909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40628875-4d31-4fb3-a324-7f6e374a5901 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:23:48.563480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9a5b6a26-27bd-4596-9935-eb8377483d45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:48.564224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9a5b6a26-27bd-4596-9935-eb8377483d45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:48.571657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a5b6a26-27bd-4596-9935-eb8377483d45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.572103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a5b6a26-27bd-4596-9935-eb8377483d45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.573465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a5b6a26-27bd-4596-9935-eb8377483d45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.573891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a5b6a26-27bd-4596-9935-eb8377483d45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.609838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40628875-4d31-4fb3-a324-7f6e374a5901 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 204 len: 0 microversion: 2.1 time: 0.140018 Jun 20 06:23:48.610594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 474/961] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:23:48 2022] DELETE /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:23:48.618958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f3a448e4-9a15-4f35-b80d-2abfbd018fd9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:48.619484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3a448e4-9a15-4f35-b80d-2abfbd018fd9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:48.625680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3a448e4-9a15-4f35-b80d-2abfbd018fd9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.626129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3a448e4-9a15-4f35-b80d-2abfbd018fd9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.626895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3a448e4-9a15-4f35-b80d-2abfbd018fd9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.627323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3a448e4-9a15-4f35-b80d-2abfbd018fd9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.762044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a5b6a26-27bd-4596-9935-eb8377483d45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:48.770629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9a5b6a26-27bd-4596-9935-eb8377483d45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.214236 Jun 20 06:23:48.771497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 488/962] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:48.798160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f3a448e4-9a15-4f35-b80d-2abfbd018fd9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:48.805740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f3a448e4-9a15-4f35-b80d-2abfbd018fd9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.190931 Jun 20 06:23:48.806324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 475/963] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:48 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:49.788025 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1bf50494-9e9c-4dc1-ade8-e5fde6683251 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:49.788565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1bf50494-9e9c-4dc1-ade8-e5fde6683251 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:49.795265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bf50494-9e9c-4dc1-ade8-e5fde6683251 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:49.795712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bf50494-9e9c-4dc1-ade8-e5fde6683251 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:49.796471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bf50494-9e9c-4dc1-ade8-e5fde6683251 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:49.796906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1bf50494-9e9c-4dc1-ade8-e5fde6683251 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:49.825056 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-13607509-5511-4d2a-90ff-7d603109dfb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:49.825693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-13607509-5511-4d2a-90ff-7d603109dfb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:49.832417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13607509-5511-4d2a-90ff-7d603109dfb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:49.832900 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13607509-5511-4d2a-90ff-7d603109dfb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:49.833697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13607509-5511-4d2a-90ff-7d603109dfb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:49.834170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13607509-5511-4d2a-90ff-7d603109dfb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:49.981943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1bf50494-9e9c-4dc1-ade8-e5fde6683251 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:49.989619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1bf50494-9e9c-4dc1-ade8-e5fde6683251 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.205443 Jun 20 06:23:49.990227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 489/964] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:50.010558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-13607509-5511-4d2a-90ff-7d603109dfb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:50.018411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-13607509-5511-4d2a-90ff-7d603109dfb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.198361 Jun 20 06:23:50.018976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 476/965] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:49 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:51.007392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-88044b8b-c5f2-4c6f-a0cf-1508acbd32e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:51.007998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-88044b8b-c5f2-4c6f-a0cf-1508acbd32e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:51.015214 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88044b8b-c5f2-4c6f-a0cf-1508acbd32e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:51.015664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88044b8b-c5f2-4c6f-a0cf-1508acbd32e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:51.016423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88044b8b-c5f2-4c6f-a0cf-1508acbd32e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:51.016856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88044b8b-c5f2-4c6f-a0cf-1508acbd32e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:51.035278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4818ccc6-e6e0-4f87-936a-953760e615a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:51.035883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4818ccc6-e6e0-4f87-936a-953760e615a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:51.042235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4818ccc6-e6e0-4f87-936a-953760e615a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:51.042629 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4818ccc6-e6e0-4f87-936a-953760e615a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:51.043396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4818ccc6-e6e0-4f87-936a-953760e615a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:51.043827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4818ccc6-e6e0-4f87-936a-953760e615a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:51.223449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-88044b8b-c5f2-4c6f-a0cf-1508acbd32e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:51.227107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4818ccc6-e6e0-4f87-936a-953760e615a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:51.231125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-88044b8b-c5f2-4c6f-a0cf-1508acbd32e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.227555 Jun 20 06:23:51.231918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 490/966] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:51.234808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4818ccc6-e6e0-4f87-936a-953760e615a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.203260 Jun 20 06:23:51.235367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 477/967] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:51 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:52.247909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-67b63d1e-87c9-4adc-b332-f304ebb8a8f3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:52.248499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-67b63d1e-87c9-4adc-b332-f304ebb8a8f3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:52.251189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5100830b-6494-4183-bd3c-3bc37eec7160 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:52.251931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5100830b-6494-4183-bd3c-3bc37eec7160 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:52.254997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67b63d1e-87c9-4adc-b332-f304ebb8a8f3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:52.255440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67b63d1e-87c9-4adc-b332-f304ebb8a8f3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:52.256271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67b63d1e-87c9-4adc-b332-f304ebb8a8f3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:52.256702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67b63d1e-87c9-4adc-b332-f304ebb8a8f3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:52.258433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5100830b-6494-4183-bd3c-3bc37eec7160 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:52.258886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5100830b-6494-4183-bd3c-3bc37eec7160 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:52.259644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5100830b-6494-4183-bd3c-3bc37eec7160 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:52.260074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5100830b-6494-4183-bd3c-3bc37eec7160 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:52.454340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-67b63d1e-87c9-4adc-b332-f304ebb8a8f3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:52.458961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5100830b-6494-4183-bd3c-3bc37eec7160 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:52.461737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-67b63d1e-87c9-4adc-b332-f304ebb8a8f3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.217735 Jun 20 06:23:52.462302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 491/968] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:52.467292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5100830b-6494-4183-bd3c-3bc37eec7160 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.219875 Jun 20 06:23:52.467852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 478/969] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:52 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:53.479430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dfe212aa-d9e7-4b55-ac3f-e4f80c49def7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:53.480608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dfe212aa-d9e7-4b55-ac3f-e4f80c49def7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:53.484360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9a10368b-74e8-4123-8a40-0c9039016b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:53.484982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9a10368b-74e8-4123-8a40-0c9039016b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:53.487102 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfe212aa-d9e7-4b55-ac3f-e4f80c49def7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:53.487551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfe212aa-d9e7-4b55-ac3f-e4f80c49def7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:53.488322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfe212aa-d9e7-4b55-ac3f-e4f80c49def7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:53.488753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfe212aa-d9e7-4b55-ac3f-e4f80c49def7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:53.491158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a10368b-74e8-4123-8a40-0c9039016b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:53.491609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a10368b-74e8-4123-8a40-0c9039016b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:53.492387 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a10368b-74e8-4123-8a40-0c9039016b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:53.492826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a10368b-74e8-4123-8a40-0c9039016b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:53.682555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dfe212aa-d9e7-4b55-ac3f-e4f80c49def7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:53.690513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dfe212aa-d9e7-4b55-ac3f-e4f80c49def7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.214913 Jun 20 06:23:53.691376 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 492/970] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:53 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:53.699977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a10368b-74e8-4123-8a40-0c9039016b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:53.708416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9a10368b-74e8-4123-8a40-0c9039016b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.228449 Jun 20 06:23:53.708986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 479/971] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:53 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:54.708041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-53c91543-da2d-4cec-b02e-f12715fb3b1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:54.708651 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-53c91543-da2d-4cec-b02e-f12715fb3b1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:54.715760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53c91543-da2d-4cec-b02e-f12715fb3b1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:54.716211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53c91543-da2d-4cec-b02e-f12715fb3b1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:54.716976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53c91543-da2d-4cec-b02e-f12715fb3b1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:54.717509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53c91543-da2d-4cec-b02e-f12715fb3b1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:54.725940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-346dc24c-8a85-40eb-9305-2ec3c97d8c76 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:54.726560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-346dc24c-8a85-40eb-9305-2ec3c97d8c76 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:54.733943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-346dc24c-8a85-40eb-9305-2ec3c97d8c76 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:54.734406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-346dc24c-8a85-40eb-9305-2ec3c97d8c76 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:54.735185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-346dc24c-8a85-40eb-9305-2ec3c97d8c76 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:54.735624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-346dc24c-8a85-40eb-9305-2ec3c97d8c76 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:54.739703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:54.924620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-53c91543-da2d-4cec-b02e-f12715fb3b1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:54.927928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-346dc24c-8a85-40eb-9305-2ec3c97d8c76 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:54.932170 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-53c91543-da2d-4cec-b02e-f12715fb3b1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.227926 Jun 20 06:23:54.932833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 493/972] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:54.935629 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-346dc24c-8a85-40eb-9305-2ec3c97d8c76 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.213485 Jun 20 06:23:54.936189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 480/973] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:54 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:55.950260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dde019a5-be1b-462e-b348-20dac61fe1b3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:55.950781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dde019a5-be1b-462e-b348-20dac61fe1b3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:55.952652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fe745942-ab54-4720-9abd-0d76ba4273d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:55.953265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fe745942-ab54-4720-9abd-0d76ba4273d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:55.957327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dde019a5-be1b-462e-b348-20dac61fe1b3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:55.957806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dde019a5-be1b-462e-b348-20dac61fe1b3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:55.958561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dde019a5-be1b-462e-b348-20dac61fe1b3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:55.958984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dde019a5-be1b-462e-b348-20dac61fe1b3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:55.959559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe745942-ab54-4720-9abd-0d76ba4273d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:55.960019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe745942-ab54-4720-9abd-0d76ba4273d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:55.960785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe745942-ab54-4720-9abd-0d76ba4273d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:55.961222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe745942-ab54-4720-9abd-0d76ba4273d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:56.156304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dde019a5-be1b-462e-b348-20dac61fe1b3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:56.159724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fe745942-ab54-4720-9abd-0d76ba4273d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:56.164018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dde019a5-be1b-462e-b348-20dac61fe1b3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.218127 Jun 20 06:23:56.164670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 494/974] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:56.167299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fe745942-ab54-4720-9abd-0d76ba4273d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.218922 Jun 20 06:23:56.167873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 481/975] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:55 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:57.181728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b8c2e01d-cd6a-4cf3-a1f1-de1da124a355 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:57.182970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b8c2e01d-cd6a-4cf3-a1f1-de1da124a355 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:57.185695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-73474771-056e-4bad-87ac-4330423779da tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:57.186313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-73474771-056e-4bad-87ac-4330423779da tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:57.189616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8c2e01d-cd6a-4cf3-a1f1-de1da124a355 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:57.190069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8c2e01d-cd6a-4cf3-a1f1-de1da124a355 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:57.190843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8c2e01d-cd6a-4cf3-a1f1-de1da124a355 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:57.191280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8c2e01d-cd6a-4cf3-a1f1-de1da124a355 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:57.193584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73474771-056e-4bad-87ac-4330423779da tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:57.194039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73474771-056e-4bad-87ac-4330423779da tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:57.194809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73474771-056e-4bad-87ac-4330423779da tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:57.195248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73474771-056e-4bad-87ac-4330423779da tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:57.206728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:57.393951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b8c2e01d-cd6a-4cf3-a1f1-de1da124a355 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:57.397540 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-73474771-056e-4bad-87ac-4330423779da tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:57.401423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b8c2e01d-cd6a-4cf3-a1f1-de1da124a355 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.223622 Jun 20 06:23:57.401995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 495/976] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:57.405275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-73474771-056e-4bad-87ac-4330423779da tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.225680 Jun 20 06:23:57.405872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 482/977] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:57 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:58.418059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9ba606cb-ca56-4d84-b27d-75829f82133a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:58.419129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9ba606cb-ca56-4d84-b27d-75829f82133a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:58.422453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee880a40-65e6-4f96-ac99-1a7e79faf707 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:58.423072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee880a40-65e6-4f96-ac99-1a7e79faf707 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:58.425777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ba606cb-ca56-4d84-b27d-75829f82133a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:58.426235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ba606cb-ca56-4d84-b27d-75829f82133a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:58.427005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ba606cb-ca56-4d84-b27d-75829f82133a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:58.427441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ba606cb-ca56-4d84-b27d-75829f82133a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:58.429711 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee880a40-65e6-4f96-ac99-1a7e79faf707 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:58.430193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee880a40-65e6-4f96-ac99-1a7e79faf707 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:58.430952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee880a40-65e6-4f96-ac99-1a7e79faf707 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:58.431384 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee880a40-65e6-4f96-ac99-1a7e79faf707 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:58.633166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9ba606cb-ca56-4d84-b27d-75829f82133a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:58.638645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ee880a40-65e6-4f96-ac99-1a7e79faf707 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:58.641463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9ba606cb-ca56-4d84-b27d-75829f82133a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.227422 Jun 20 06:23:58.642041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 496/978] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:58.646619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee880a40-65e6-4f96-ac99-1a7e79faf707 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.228289 Jun 20 06:23:58.647188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 483/979] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:58 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:59.660077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-574b7eac-e6e2-40d9-84b9-fdd9ffc7c3cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:59.660685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-574b7eac-e6e2-40d9-84b9-fdd9ffc7c3cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:59.663549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-216607a1-d392-476b-9b1c-6b1919fcf8c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:59.664157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-216607a1-d392-476b-9b1c-6b1919fcf8c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:59.667274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-574b7eac-e6e2-40d9-84b9-fdd9ffc7c3cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:59.667725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-574b7eac-e6e2-40d9-84b9-fdd9ffc7c3cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:59.668517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-574b7eac-e6e2-40d9-84b9-fdd9ffc7c3cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:59.668948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-574b7eac-e6e2-40d9-84b9-fdd9ffc7c3cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:59.670676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-216607a1-d392-476b-9b1c-6b1919fcf8c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:59.671168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-216607a1-d392-476b-9b1c-6b1919fcf8c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:59.671936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-216607a1-d392-476b-9b1c-6b1919fcf8c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:59.672368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-216607a1-d392-476b-9b1c-6b1919fcf8c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:59.869384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-574b7eac-e6e2-40d9-84b9-fdd9ffc7c3cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:59.873130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-216607a1-d392-476b-9b1c-6b1919fcf8c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:59.877366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-574b7eac-e6e2-40d9-84b9-fdd9ffc7c3cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.221188 Jun 20 06:23:59.880639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-216607a1-d392-476b-9b1c-6b1919fcf8c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.220795 Jun 20 06:23:59.881098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 497/980] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:59.881476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 484/981] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:59 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:00.894683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-286111e8-dfd9-4cc4-8ca6-e413fbd26eb2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:00.895305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-286111e8-dfd9-4cc4-8ca6-e413fbd26eb2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:00.898030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-105f8bab-e6b3-4f86-8d3d-7f301ef71d97 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:00.898639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-105f8bab-e6b3-4f86-8d3d-7f301ef71d97 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:00.902065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-286111e8-dfd9-4cc4-8ca6-e413fbd26eb2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:00.902552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-286111e8-dfd9-4cc4-8ca6-e413fbd26eb2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:00.903520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-286111e8-dfd9-4cc4-8ca6-e413fbd26eb2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:00.903961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-286111e8-dfd9-4cc4-8ca6-e413fbd26eb2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:00.905082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-105f8bab-e6b3-4f86-8d3d-7f301ef71d97 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:00.905570 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-105f8bab-e6b3-4f86-8d3d-7f301ef71d97 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:00.906326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-105f8bab-e6b3-4f86-8d3d-7f301ef71d97 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:00.906756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-105f8bab-e6b3-4f86-8d3d-7f301ef71d97 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:01.096833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-105f8bab-e6b3-4f86-8d3d-7f301ef71d97 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:01.104440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-105f8bab-e6b3-4f86-8d3d-7f301ef71d97 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.210114 Jun 20 06:24:01.105018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 485/982] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:00 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:01.105959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-286111e8-dfd9-4cc4-8ca6-e413fbd26eb2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:01.113447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-286111e8-dfd9-4cc4-8ca6-e413fbd26eb2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.223076 Jun 20 06:24:01.113995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 498/983] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:02.122706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a8cb43cf-f0df-41c2-9d70-0310bbc1dae9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:02.123243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a8cb43cf-f0df-41c2-9d70-0310bbc1dae9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:02.129783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8cb43cf-f0df-41c2-9d70-0310bbc1dae9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:02.130094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-501d8305-90f0-4742-af8e-b426db230ab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:02.130506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8cb43cf-f0df-41c2-9d70-0310bbc1dae9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:02.130701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-501d8305-90f0-4742-af8e-b426db230ab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:02.130984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8cb43cf-f0df-41c2-9d70-0310bbc1dae9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:02.131431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a8cb43cf-f0df-41c2-9d70-0310bbc1dae9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:02.138075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-501d8305-90f0-4742-af8e-b426db230ab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:02.138829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-501d8305-90f0-4742-af8e-b426db230ab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:02.139600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-501d8305-90f0-4742-af8e-b426db230ab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:02.140031 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-501d8305-90f0-4742-af8e-b426db230ab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:02.333689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a8cb43cf-f0df-41c2-9d70-0310bbc1dae9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:02.337834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-501d8305-90f0-4742-af8e-b426db230ab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:02.341993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a8cb43cf-f0df-41c2-9d70-0310bbc1dae9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.223602 Jun 20 06:24:02.342611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 486/984] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:02 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:02.345934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-501d8305-90f0-4742-af8e-b426db230ab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.219482 Jun 20 06:24:02.346771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 499/985] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:03.359389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e5473f85-134c-4f0a-8bb3-8528cc98c5a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:03.360002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e5473f85-134c-4f0a-8bb3-8528cc98c5a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:03.362189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5fc9d5ea-faa5-440c-8da0-f87e51e12a91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:03.362813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5fc9d5ea-faa5-440c-8da0-f87e51e12a91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:03.366798 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e5473f85-134c-4f0a-8bb3-8528cc98c5a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:03.367282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e5473f85-134c-4f0a-8bb3-8528cc98c5a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:03.368061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e5473f85-134c-4f0a-8bb3-8528cc98c5a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:03.368496 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e5473f85-134c-4f0a-8bb3-8528cc98c5a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:03.368855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fc9d5ea-faa5-440c-8da0-f87e51e12a91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:03.369311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fc9d5ea-faa5-440c-8da0-f87e51e12a91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:03.370130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fc9d5ea-faa5-440c-8da0-f87e51e12a91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:03.370567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fc9d5ea-faa5-440c-8da0-f87e51e12a91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:03.570700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e5473f85-134c-4f0a-8bb3-8528cc98c5a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:03.574861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5fc9d5ea-faa5-440c-8da0-f87e51e12a91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:03.579437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e5473f85-134c-4f0a-8bb3-8528cc98c5a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.224236 Jun 20 06:24:03.580143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 487/986] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:03 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:03.582453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5fc9d5ea-faa5-440c-8da0-f87e51e12a91 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.224310 Jun 20 06:24:03.582956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 500/987] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:04.596564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5844ba9a-9816-4a88-bd45-46c3dea852fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:04.597072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5844ba9a-9816-4a88-bd45-46c3dea852fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:04.599250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-34ae3104-e0b6-47cd-9d86-1f86381f5522 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:04.599857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-34ae3104-e0b6-47cd-9d86-1f86381f5522 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:04.603518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5844ba9a-9816-4a88-bd45-46c3dea852fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:04.603963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5844ba9a-9816-4a88-bd45-46c3dea852fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:04.604728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5844ba9a-9816-4a88-bd45-46c3dea852fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:04.605160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5844ba9a-9816-4a88-bd45-46c3dea852fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:04.607059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-34ae3104-e0b6-47cd-9d86-1f86381f5522 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:04.607503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-34ae3104-e0b6-47cd-9d86-1f86381f5522 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:04.608255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-34ae3104-e0b6-47cd-9d86-1f86381f5522 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:04.608680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-34ae3104-e0b6-47cd-9d86-1f86381f5522 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:04.805948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-34ae3104-e0b6-47cd-9d86-1f86381f5522 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:04.813832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-34ae3104-e0b6-47cd-9d86-1f86381f5522 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.218378 Jun 20 06:24:04.814407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 501/988] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:04.819322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5844ba9a-9816-4a88-bd45-46c3dea852fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:04.827991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5844ba9a-9816-4a88-bd45-46c3dea852fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.235364 Jun 20 06:24:04.828545 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 488/989] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:04 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:05.831028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d6ab38dc-f202-4297-a5ad-33558211b8cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:05.831641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d6ab38dc-f202-4297-a5ad-33558211b8cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:05.833930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=42 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:05.839102 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6ab38dc-f202-4297-a5ad-33558211b8cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:05.839557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6ab38dc-f202-4297-a5ad-33558211b8cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:05.840632 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6ab38dc-f202-4297-a5ad-33558211b8cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:05.840859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6ab38dc-f202-4297-a5ad-33558211b8cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:05.845572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-39baca5c-cafa-4c77-8f9e-9c65ee738c73 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:05.846193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-39baca5c-cafa-4c77-8f9e-9c65ee738c73 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:05.852543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39baca5c-cafa-4c77-8f9e-9c65ee738c73 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:05.853002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39baca5c-cafa-4c77-8f9e-9c65ee738c73 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:05.853813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39baca5c-cafa-4c77-8f9e-9c65ee738c73 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:05.854255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39baca5c-cafa-4c77-8f9e-9c65ee738c73 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:06.038800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d6ab38dc-f202-4297-a5ad-33558211b8cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:06.047106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d6ab38dc-f202-4297-a5ad-33558211b8cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.219891 Jun 20 06:24:06.047685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 502/990] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:06.047914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-39baca5c-cafa-4c77-8f9e-9c65ee738c73 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:06.055583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-39baca5c-cafa-4c77-8f9e-9c65ee738c73 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.213892 Jun 20 06:24:06.056139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 489/991] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:05 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:07.064692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1dc79424-c43a-4f0f-9b8b-aea94090d8d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:07.065302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1dc79424-c43a-4f0f-9b8b-aea94090d8d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:07.071872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a14bcc6-2067-41a1-87ee-07f05f0d2896 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:07.072499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a14bcc6-2067-41a1-87ee-07f05f0d2896 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:07.082282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:07.084622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1dc79424-c43a-4f0f-9b8b-aea94090d8d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:07.085086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1dc79424-c43a-4f0f-9b8b-aea94090d8d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:07.085896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1dc79424-c43a-4f0f-9b8b-aea94090d8d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:07.086338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1dc79424-c43a-4f0f-9b8b-aea94090d8d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:07.092112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a14bcc6-2067-41a1-87ee-07f05f0d2896 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:07.092112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a14bcc6-2067-41a1-87ee-07f05f0d2896 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:07.092112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a14bcc6-2067-41a1-87ee-07f05f0d2896 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:07.092603 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a14bcc6-2067-41a1-87ee-07f05f0d2896 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:07.720799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1dc79424-c43a-4f0f-9b8b-aea94090d8d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:07.728302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1dc79424-c43a-4f0f-9b8b-aea94090d8d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.667498 Jun 20 06:24:07.728876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 503/992] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:07.754278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a14bcc6-2067-41a1-87ee-07f05f0d2896 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:07.761963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a14bcc6-2067-41a1-87ee-07f05f0d2896 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1578 microversion: 2.1 time: 0.693821 Jun 20 06:24:07.762534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 490/993] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:07 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1578 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:08.188165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-5367c902-05da-4c97-9380-cc1e121064c0 req-8de45669-28a5-4c2d-a83c-a0bac8f8d384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabdd9ee-515b-492e-82b7-aae14f44c6fb", "name": "network-vif-deleted", "tag": "4328b13c-3245-46f3-b4dd-7636eaa4cd6f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:08.197029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-5367c902-05da-4c97-9380-cc1e121064c0 req-8de45669-28a5-4c2d-a83c-a0bac8f8d384 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:08.197776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-5367c902-05da-4c97-9380-cc1e121064c0 req-8de45669-28a5-4c2d-a83c-a0bac8f8d384 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:08.210321 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-5367c902-05da-4c97-9380-cc1e121064c0 req-8de45669-28a5-4c2d-a83c-a0bac8f8d384 service nova] Creating event network-vif-deleted:4328b13c-3245-46f3-b4dd-7636eaa4cd6f for instance cabdd9ee-515b-492e-82b7-aae14f44c6fb on hv-cinder-80473 Jun 20 06:24:08.215295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-5367c902-05da-4c97-9380-cc1e121064c0 req-8de45669-28a5-4c2d-a83c-a0bac8f8d384 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Jun 20 06:24:08.215918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 504/994] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:24:08.747172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-84105b74-61be-4bb4-a710-8d5312ad8cc5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:08.747953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-84105b74-61be-4bb4-a710-8d5312ad8cc5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:08.754573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84105b74-61be-4bb4-a710-8d5312ad8cc5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:08.755017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84105b74-61be-4bb4-a710-8d5312ad8cc5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:08.755786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84105b74-61be-4bb4-a710-8d5312ad8cc5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:08.756217 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84105b74-61be-4bb4-a710-8d5312ad8cc5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:08.780030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad14fbe0-8da2-481b-9c92-f1fdb2bc28de tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:08.780701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ad14fbe0-8da2-481b-9c92-f1fdb2bc28de tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:08.786920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad14fbe0-8da2-481b-9c92-f1fdb2bc28de tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:08.787370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad14fbe0-8da2-481b-9c92-f1fdb2bc28de tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:08.788149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad14fbe0-8da2-481b-9c92-f1fdb2bc28de tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:08.788568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad14fbe0-8da2-481b-9c92-f1fdb2bc28de tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:08.874386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ad14fbe0-8da2-481b-9c92-f1fdb2bc28de tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:08.882093 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ad14fbe0-8da2-481b-9c92-f1fdb2bc28de tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.106602 Jun 20 06:24:08.882665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 505/995] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:08 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:08.913715 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84105b74-61be-4bb4-a710-8d5312ad8cc5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:08.922006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-84105b74-61be-4bb4-a710-8d5312ad8cc5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.179868 Jun 20 06:24:08.922593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 491/996] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:09.898661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f0198875-f991-4328-a258-2f35a56c9897 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:09.899282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f0198875-f991-4328-a258-2f35a56c9897 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:09.906482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0198875-f991-4328-a258-2f35a56c9897 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:09.906931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0198875-f991-4328-a258-2f35a56c9897 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:09.907706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0198875-f991-4328-a258-2f35a56c9897 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:09.908144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0198875-f991-4328-a258-2f35a56c9897 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:09.938959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0912091e-e314-4369-a0e8-163ecf13c0cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:09.939565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0912091e-e314-4369-a0e8-163ecf13c0cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:09.946220 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0912091e-e314-4369-a0e8-163ecf13c0cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:09.946670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0912091e-e314-4369-a0e8-163ecf13c0cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:09.947442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0912091e-e314-4369-a0e8-163ecf13c0cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:09.947874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0912091e-e314-4369-a0e8-163ecf13c0cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:09.973709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f0198875-f991-4328-a258-2f35a56c9897 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:09.981856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f0198875-f991-4328-a258-2f35a56c9897 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086496 Jun 20 06:24:09.982421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 506/997] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:09 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:10.082020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0912091e-e314-4369-a0e8-163ecf13c0cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:10.089774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0912091e-e314-4369-a0e8-163ecf13c0cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.154524 Jun 20 06:24:10.090338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 492/998] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:11.001227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6dd4bf29-6bfc-40b7-b508-6fc6c574c7ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:11.001825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6dd4bf29-6bfc-40b7-b508-6fc6c574c7ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:11.009909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6dd4bf29-6bfc-40b7-b508-6fc6c574c7ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:11.010575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6dd4bf29-6bfc-40b7-b508-6fc6c574c7ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:11.011622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6dd4bf29-6bfc-40b7-b508-6fc6c574c7ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:11.012822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6dd4bf29-6bfc-40b7-b508-6fc6c574c7ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:11.085936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6dd4bf29-6bfc-40b7-b508-6fc6c574c7ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:11.094152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6dd4bf29-6bfc-40b7-b508-6fc6c574c7ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.099361 Jun 20 06:24:11.094712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 507/999] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:10 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:11.107061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fb12048f-62ca-47d6-b0fb-02c2d2956b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:11.107680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fb12048f-62ca-47d6-b0fb-02c2d2956b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:11.114351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb12048f-62ca-47d6-b0fb-02c2d2956b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:11.114810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb12048f-62ca-47d6-b0fb-02c2d2956b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:11.115590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb12048f-62ca-47d6-b0fb-02c2d2956b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:11.116036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb12048f-62ca-47d6-b0fb-02c2d2956b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:11.251189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fb12048f-62ca-47d6-b0fb-02c2d2956b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:11.258847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fb12048f-62ca-47d6-b0fb-02c2d2956b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.155578 Jun 20 06:24:11.259351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 493/1000] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:11.588469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-4ff6e4a7-04ef-42a0-9140-735814a89315 req-6a6ab4bc-bdc4-44c6-8936-62118b01afa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0ade09-352b-4eb4-8c02-2bc3e8ed1c19", "name": "network-vif-plugged", "status": "completed", "tag": "c0a4dc40-28c7-4749-ab81-fe55f9a8c0da"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:11.597215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-4ff6e4a7-04ef-42a0-9140-735814a89315 req-6a6ab4bc-bdc4-44c6-8936-62118b01afa2 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:11.597729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-4ff6e4a7-04ef-42a0-9140-735814a89315 req-6a6ab4bc-bdc4-44c6-8936-62118b01afa2 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:11.609912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-4ff6e4a7-04ef-42a0-9140-735814a89315 req-6a6ab4bc-bdc4-44c6-8936-62118b01afa2 service nova] Creating event network-vif-plugged:c0a4dc40-28c7-4749-ab81-fe55f9a8c0da for instance df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 on hv-cinder-80473 Jun 20 06:24:11.614808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-4ff6e4a7-04ef-42a0-9140-735814a89315 req-6a6ab4bc-bdc4-44c6-8936-62118b01afa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 Jun 20 06:24:11.615448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 508/1001] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:24:12.113135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-20572f10-f127-4864-991f-d93655ffd45f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:12.113952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-20572f10-f127-4864-991f-d93655ffd45f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:12.121317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20572f10-f127-4864-991f-d93655ffd45f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.121850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20572f10-f127-4864-991f-d93655ffd45f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.122631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20572f10-f127-4864-991f-d93655ffd45f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.123072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20572f10-f127-4864-991f-d93655ffd45f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.190951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-20572f10-f127-4864-991f-d93655ffd45f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:12.200646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-20572f10-f127-4864-991f-d93655ffd45f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.092289 Jun 20 06:24:12.201346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 494/1002] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:12 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:12.277320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a84f054e-43af-490c-94c5-32b1e8087f51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:12.278698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a84f054e-43af-490c-94c5-32b1e8087f51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:12.284882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a84f054e-43af-490c-94c5-32b1e8087f51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.285329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a84f054e-43af-490c-94c5-32b1e8087f51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.286111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a84f054e-43af-490c-94c5-32b1e8087f51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.286545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a84f054e-43af-490c-94c5-32b1e8087f51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.421351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a84f054e-43af-490c-94c5-32b1e8087f51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:12.428715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a84f054e-43af-490c-94c5-32b1e8087f51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.156011 Jun 20 06:24:12.429272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 509/1003] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:13.217804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ad8fb760-286f-40c1-ac1a-ffd46ba2cc7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:13.218416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ad8fb760-286f-40c1-ac1a-ffd46ba2cc7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:13.224927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad8fb760-286f-40c1-ac1a-ffd46ba2cc7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:13.225401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad8fb760-286f-40c1-ac1a-ffd46ba2cc7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:13.226184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad8fb760-286f-40c1-ac1a-ffd46ba2cc7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:13.226626 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad8fb760-286f-40c1-ac1a-ffd46ba2cc7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:13.295486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ad8fb760-286f-40c1-ac1a-ffd46ba2cc7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:13.303213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ad8fb760-286f-40c1-ac1a-ffd46ba2cc7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.089904 Jun 20 06:24:13.303788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 495/1004] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:13 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:13.445757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e4f40f82-50a0-4242-81d8-4f13c0b0a31d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:13.446337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e4f40f82-50a0-4242-81d8-4f13c0b0a31d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:13.453307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f40f82-50a0-4242-81d8-4f13c0b0a31d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:13.453785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f40f82-50a0-4242-81d8-4f13c0b0a31d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:13.454548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f40f82-50a0-4242-81d8-4f13c0b0a31d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:13.454984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f40f82-50a0-4242-81d8-4f13c0b0a31d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:13.610157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e4f40f82-50a0-4242-81d8-4f13c0b0a31d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:13.620046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e4f40f82-50a0-4242-81d8-4f13c0b0a31d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1259 microversion: 2.1 time: 0.178143 Jun 20 06:24:13.620753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 510/1005] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:14.321923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ebd8e34c-5ab6-47d2-9da4-0c7b89bbe830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:14.322535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ebd8e34c-5ab6-47d2-9da4-0c7b89bbe830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:14.330734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebd8e34c-5ab6-47d2-9da4-0c7b89bbe830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:14.331190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebd8e34c-5ab6-47d2-9da4-0c7b89bbe830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.332123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebd8e34c-5ab6-47d2-9da4-0c7b89bbe830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:14.332434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebd8e34c-5ab6-47d2-9da4-0c7b89bbe830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.405492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ebd8e34c-5ab6-47d2-9da4-0c7b89bbe830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:14.407678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:14.414376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ebd8e34c-5ab6-47d2-9da4-0c7b89bbe830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.097659 Jun 20 06:24:14.414942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 496/1006] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:14 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:14.642394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-122d5f03-f5df-4741-bfa0-c5b515f45cb3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:14.643283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-122d5f03-f5df-4741-bfa0-c5b515f45cb3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:14.649867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-122d5f03-f5df-4741-bfa0-c5b515f45cb3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:14.650315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-122d5f03-f5df-4741-bfa0-c5b515f45cb3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.651076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-122d5f03-f5df-4741-bfa0-c5b515f45cb3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:14.651509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-122d5f03-f5df-4741-bfa0-c5b515f45cb3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.784749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-122d5f03-f5df-4741-bfa0-c5b515f45cb3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:14.792972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-122d5f03-f5df-4741-bfa0-c5b515f45cb3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1443 microversion: 2.1 time: 0.154433 Jun 20 06:24:14.793677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 511/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:14.811990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-45a999a0-e611-4ddf-aa50-6850bf39e862 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:14.812605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-45a999a0-e611-4ddf-aa50-6850bf39e862 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:14.818938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45a999a0-e611-4ddf-aa50-6850bf39e862 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:14.819389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45a999a0-e611-4ddf-aa50-6850bf39e862 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.820155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45a999a0-e611-4ddf-aa50-6850bf39e862 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:14.820593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45a999a0-e611-4ddf-aa50-6850bf39e862 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.955516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-45a999a0-e611-4ddf-aa50-6850bf39e862 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:14.963178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-45a999a0-e611-4ddf-aa50-6850bf39e862 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1443 microversion: 2.1 time: 0.156027 Jun 20 06:24:14.963752 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 497/1008] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:15.431521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ee5d73e5-b55c-41c5-9c07-165e91130d24 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:15.432135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ee5d73e5-b55c-41c5-9c07-165e91130d24 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:15.439478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee5d73e5-b55c-41c5-9c07-165e91130d24 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:15.439935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee5d73e5-b55c-41c5-9c07-165e91130d24 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:15.440714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee5d73e5-b55c-41c5-9c07-165e91130d24 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:15.441151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee5d73e5-b55c-41c5-9c07-165e91130d24 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:15.541145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ee5d73e5-b55c-41c5-9c07-165e91130d24 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:15.553584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ee5d73e5-b55c-41c5-9c07-165e91130d24 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.125996 Jun 20 06:24:15.563084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 512/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:15 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:16.570810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f6298a56-ca3c-4213-9cec-d6b4f0585352 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:16.571510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f6298a56-ca3c-4213-9cec-d6b4f0585352 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:16.579356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6298a56-ca3c-4213-9cec-d6b4f0585352 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.579811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6298a56-ca3c-4213-9cec-d6b4f0585352 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.580590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6298a56-ca3c-4213-9cec-d6b4f0585352 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.581030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6298a56-ca3c-4213-9cec-d6b4f0585352 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.648805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6298a56-ca3c-4213-9cec-d6b4f0585352 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:16.657277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f6298a56-ca3c-4213-9cec-d6b4f0585352 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.090313 Jun 20 06:24:16.666429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 498/1010] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:16 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:16.693437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-32126354-7c90-4331-bf25-0633c72bc06d req-2c013037-084b-4623-b90f-bfe2bf1e88cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0ade09-352b-4eb4-8c02-2bc3e8ed1c19", "tag": "c0a4dc40-28c7-4749-ab81-fe55f9a8c0da"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:16.702854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-32126354-7c90-4331-bf25-0633c72bc06d req-2c013037-084b-4623-b90f-bfe2bf1e88cc service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.703295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-32126354-7c90-4331-bf25-0633c72bc06d req-2c013037-084b-4623-b90f-bfe2bf1e88cc service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.715775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-32126354-7c90-4331-bf25-0633c72bc06d req-2c013037-084b-4623-b90f-bfe2bf1e88cc service nova] Creating event network-changed:c0a4dc40-28c7-4749-ab81-fe55f9a8c0da for instance df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 on hv-cinder-80473 Jun 20 06:24:16.721157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-32126354-7c90-4331-bf25-0633c72bc06d req-2c013037-084b-4623-b90f-bfe2bf1e88cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031381 Jun 20 06:24:16.721793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 513/1011] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:24:17.674693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0fc882b1-5c8a-4c42-82f6-e83b4f9f5f65 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:17.675344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0fc882b1-5c8a-4c42-82f6-e83b4f9f5f65 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:17.682481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fc882b1-5c8a-4c42-82f6-e83b4f9f5f65 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:17.682936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fc882b1-5c8a-4c42-82f6-e83b4f9f5f65 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:17.683721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fc882b1-5c8a-4c42-82f6-e83b4f9f5f65 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:17.684942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fc882b1-5c8a-4c42-82f6-e83b4f9f5f65 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:17.748537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0fc882b1-5c8a-4c42-82f6-e83b4f9f5f65 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:17.756208 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0fc882b1-5c8a-4c42-82f6-e83b4f9f5f65 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085422 Jun 20 06:24:17.756780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 499/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:17 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:18.774964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc7f1038-a1ed-41ce-8cd5-fda629ae6824 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:18.775671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc7f1038-a1ed-41ce-8cd5-fda629ae6824 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:18.782492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc7f1038-a1ed-41ce-8cd5-fda629ae6824 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:18.782945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc7f1038-a1ed-41ce-8cd5-fda629ae6824 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:18.783717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc7f1038-a1ed-41ce-8cd5-fda629ae6824 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:18.784154 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc7f1038-a1ed-41ce-8cd5-fda629ae6824 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:18.788300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:18.873515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc7f1038-a1ed-41ce-8cd5-fda629ae6824 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:18.880977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc7f1038-a1ed-41ce-8cd5-fda629ae6824 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.110713 Jun 20 06:24:18.881585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 514/1013] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:18 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:19.898555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-84953a62-7390-4318-aa70-e5c34acd8b1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:19.899167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-84953a62-7390-4318-aa70-e5c34acd8b1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:19.906848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84953a62-7390-4318-aa70-e5c34acd8b1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:19.907297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84953a62-7390-4318-aa70-e5c34acd8b1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:19.908058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84953a62-7390-4318-aa70-e5c34acd8b1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:19.908498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84953a62-7390-4318-aa70-e5c34acd8b1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:19.974466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84953a62-7390-4318-aa70-e5c34acd8b1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:19.982069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-84953a62-7390-4318-aa70-e5c34acd8b1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087413 Jun 20 06:24:19.982624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 500/1014] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:19 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:20.999234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b90bf201-c336-4d3e-b1d8-d83a8154d7f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:20.999847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b90bf201-c336-4d3e-b1d8-d83a8154d7f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:21.006328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b90bf201-c336-4d3e-b1d8-d83a8154d7f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:21.006780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b90bf201-c336-4d3e-b1d8-d83a8154d7f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:21.007553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b90bf201-c336-4d3e-b1d8-d83a8154d7f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:21.007989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b90bf201-c336-4d3e-b1d8-d83a8154d7f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:21.070599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b90bf201-c336-4d3e-b1d8-d83a8154d7f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:21.078674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b90bf201-c336-4d3e-b1d8-d83a8154d7f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083868 Jun 20 06:24:21.079237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 515/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:20 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:22.096170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-06da879f-f4d4-4ea5-b54e-24acf8ce33e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:22.096811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-06da879f-f4d4-4ea5-b54e-24acf8ce33e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:22.103290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06da879f-f4d4-4ea5-b54e-24acf8ce33e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:22.103735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06da879f-f4d4-4ea5-b54e-24acf8ce33e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:22.104492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06da879f-f4d4-4ea5-b54e-24acf8ce33e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:22.104928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06da879f-f4d4-4ea5-b54e-24acf8ce33e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:22.165579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-06da879f-f4d4-4ea5-b54e-24acf8ce33e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:22.173077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-06da879f-f4d4-4ea5-b54e-24acf8ce33e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080758 Jun 20 06:24:22.173665 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 501/1016] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:22 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:23.189711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7c35bbc0-5a45-4ea3-a61a-d1e32ec471e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:23.190532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7c35bbc0-5a45-4ea3-a61a-d1e32ec471e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:23.196815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c35bbc0-5a45-4ea3-a61a-d1e32ec471e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:23.197263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c35bbc0-5a45-4ea3-a61a-d1e32ec471e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:23.198072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c35bbc0-5a45-4ea3-a61a-d1e32ec471e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:23.198503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7c35bbc0-5a45-4ea3-a61a-d1e32ec471e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:23.260011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7c35bbc0-5a45-4ea3-a61a-d1e32ec471e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:23.267931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7c35bbc0-5a45-4ea3-a61a-d1e32ec471e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081928 Jun 20 06:24:23.268488 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 516/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:23 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:24.287317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5be29bbb-5046-4cdb-931a-97940facebb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:24.288032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5be29bbb-5046-4cdb-931a-97940facebb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:24.295170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5be29bbb-5046-4cdb-931a-97940facebb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:24.295612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5be29bbb-5046-4cdb-931a-97940facebb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:24.296367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5be29bbb-5046-4cdb-931a-97940facebb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:24.296807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5be29bbb-5046-4cdb-931a-97940facebb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:24.362326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5be29bbb-5046-4cdb-931a-97940facebb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:24.369785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5be29bbb-5046-4cdb-931a-97940facebb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086554 Jun 20 06:24:24.370354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 502/1018] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:24 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:25.443611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8bdb326f-3a3c-4d9a-9274-86f79039d442 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:25.444595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8bdb326f-3a3c-4d9a-9274-86f79039d442 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:25.454823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bdb326f-3a3c-4d9a-9274-86f79039d442 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:25.455535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bdb326f-3a3c-4d9a-9274-86f79039d442 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:25.456850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bdb326f-3a3c-4d9a-9274-86f79039d442 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:25.457600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8bdb326f-3a3c-4d9a-9274-86f79039d442 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:25.525126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8bdb326f-3a3c-4d9a-9274-86f79039d442 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:25.536919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8bdb326f-3a3c-4d9a-9274-86f79039d442 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.099250 Jun 20 06:24:25.537523 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 517/1019] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:25 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:26.553940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d6158629-9b28-4a5c-a8bf-fac05ad967b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:26.554548 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d6158629-9b28-4a5c-a8bf-fac05ad967b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:26.561826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6158629-9b28-4a5c-a8bf-fac05ad967b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:26.562269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6158629-9b28-4a5c-a8bf-fac05ad967b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:26.563023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6158629-9b28-4a5c-a8bf-fac05ad967b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:26.563453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d6158629-9b28-4a5c-a8bf-fac05ad967b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:26.624625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d6158629-9b28-4a5c-a8bf-fac05ad967b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:26.632296 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d6158629-9b28-4a5c-a8bf-fac05ad967b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082081 Jun 20 06:24:26.632868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 503/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:26 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:27.648286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cc234bc7-9a97-4db6-bccd-5412dd8b7145 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:27.648929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cc234bc7-9a97-4db6-bccd-5412dd8b7145 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:27.656144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc234bc7-9a97-4db6-bccd-5412dd8b7145 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:27.656590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc234bc7-9a97-4db6-bccd-5412dd8b7145 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:27.657354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc234bc7-9a97-4db6-bccd-5412dd8b7145 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:27.657815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc234bc7-9a97-4db6-bccd-5412dd8b7145 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:27.718179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cc234bc7-9a97-4db6-bccd-5412dd8b7145 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:27.725704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cc234bc7-9a97-4db6-bccd-5412dd8b7145 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081255 Jun 20 06:24:27.726269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 518/1021] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:27 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:28.743067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ae978f1b-c490-467b-8f5c-c7939c36fb67 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:28.743658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ae978f1b-c490-467b-8f5c-c7939c36fb67 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:28.751356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae978f1b-c490-467b-8f5c-c7939c36fb67 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:28.751800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae978f1b-c490-467b-8f5c-c7939c36fb67 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:28.752557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae978f1b-c490-467b-8f5c-c7939c36fb67 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:28.752988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae978f1b-c490-467b-8f5c-c7939c36fb67 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:28.817965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ae978f1b-c490-467b-8f5c-c7939c36fb67 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:28.825807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ae978f1b-c490-467b-8f5c-c7939c36fb67 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086499 Jun 20 06:24:28.826374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 504/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:28 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:28.959753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d65f429f-f454-4335-bb24-2aa002eac00a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:28.960500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d65f429f-f454-4335-bb24-2aa002eac00a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:28.966743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d65f429f-f454-4335-bb24-2aa002eac00a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:28.967186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d65f429f-f454-4335-bb24-2aa002eac00a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:28.967941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d65f429f-f454-4335-bb24-2aa002eac00a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:28.968370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d65f429f-f454-4335-bb24-2aa002eac00a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:28.990989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d65f429f-f454-4335-bb24-2aa002eac00a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7/ips" status: 200 len: 151 microversion: 2.20 time: 0.141165 Jun 20 06:24:28.991529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 519/1023] 10.222.0.16 () {60 vars in 1288 bytes} [Mon Jun 20 06:24:28 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7/ips => generated 151 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:24:29.843872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9cacad0d-f447-4a8c-8e17-176f92a2fe17 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:29.844480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9cacad0d-f447-4a8c-8e17-176f92a2fe17 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:29.850945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cacad0d-f447-4a8c-8e17-176f92a2fe17 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:29.851448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cacad0d-f447-4a8c-8e17-176f92a2fe17 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:29.852157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cacad0d-f447-4a8c-8e17-176f92a2fe17 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:29.852591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9cacad0d-f447-4a8c-8e17-176f92a2fe17 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:29.915947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9cacad0d-f447-4a8c-8e17-176f92a2fe17 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:29.924623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9cacad0d-f447-4a8c-8e17-176f92a2fe17 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085710 Jun 20 06:24:29.925185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 505/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:29 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:30.941315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7ca48bd4-6a3e-4a7f-87a9-d8c846850306 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:30.941959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7ca48bd4-6a3e-4a7f-87a9-d8c846850306 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:30.948577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7ca48bd4-6a3e-4a7f-87a9-d8c846850306 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:30.949025 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7ca48bd4-6a3e-4a7f-87a9-d8c846850306 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:30.949852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7ca48bd4-6a3e-4a7f-87a9-d8c846850306 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:30.950972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7ca48bd4-6a3e-4a7f-87a9-d8c846850306 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:31.010602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7ca48bd4-6a3e-4a7f-87a9-d8c846850306 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:31.018915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7ca48bd4-6a3e-4a7f-87a9-d8c846850306 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081419 Jun 20 06:24:31.019473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 520/1025] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:30 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:32.035444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d3faea8-3a78-442c-bd78-9567813f1d10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:32.036013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d3faea8-3a78-442c-bd78-9567813f1d10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:32.042401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d3faea8-3a78-442c-bd78-9567813f1d10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:32.042844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d3faea8-3a78-442c-bd78-9567813f1d10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:32.044437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d3faea8-3a78-442c-bd78-9567813f1d10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:32.044887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d3faea8-3a78-442c-bd78-9567813f1d10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:32.106833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d3faea8-3a78-442c-bd78-9567813f1d10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:32.114231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d3faea8-3a78-442c-bd78-9567813f1d10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082690 Jun 20 06:24:32.114800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 506/1026] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:32 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:33.130466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d5e0fcd4-b5d9-46da-8b95-7e733499df4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:33.131087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d5e0fcd4-b5d9-46da-8b95-7e733499df4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:33.137204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5e0fcd4-b5d9-46da-8b95-7e733499df4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:33.137715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5e0fcd4-b5d9-46da-8b95-7e733499df4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:33.138470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5e0fcd4-b5d9-46da-8b95-7e733499df4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:33.138904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5e0fcd4-b5d9-46da-8b95-7e733499df4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:33.203691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d5e0fcd4-b5d9-46da-8b95-7e733499df4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:33.211227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d5e0fcd4-b5d9-46da-8b95-7e733499df4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084589 Jun 20 06:24:33.211788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 521/1027] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:33 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:34.227918 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a47c1928-d535-40f7-a1d3-09586ed75b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:34.228525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a47c1928-d535-40f7-a1d3-09586ed75b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:34.235122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a47c1928-d535-40f7-a1d3-09586ed75b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:34.235564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a47c1928-d535-40f7-a1d3-09586ed75b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:34.236315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a47c1928-d535-40f7-a1d3-09586ed75b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:34.236759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a47c1928-d535-40f7-a1d3-09586ed75b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:34.296796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a47c1928-d535-40f7-a1d3-09586ed75b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:34.304310 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a47c1928-d535-40f7-a1d3-09586ed75b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080127 Jun 20 06:24:34.304878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 507/1028] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:34 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:35.321619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fdb15a0c-a87c-4273-a299-cb46b9c67087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:35.322230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fdb15a0c-a87c-4273-a299-cb46b9c67087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:35.328866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdb15a0c-a87c-4273-a299-cb46b9c67087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:35.329317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdb15a0c-a87c-4273-a299-cb46b9c67087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:35.330107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdb15a0c-a87c-4273-a299-cb46b9c67087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:35.330542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdb15a0c-a87c-4273-a299-cb46b9c67087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:35.390973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fdb15a0c-a87c-4273-a299-cb46b9c67087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:35.398608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fdb15a0c-a87c-4273-a299-cb46b9c67087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080898 Jun 20 06:24:35.399169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 522/1029] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:35 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:36.415485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cc110c25-3937-4fdc-bb1e-070e833c23f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:36.416092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cc110c25-3937-4fdc-bb1e-070e833c23f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:36.423661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc110c25-3937-4fdc-bb1e-070e833c23f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:36.424097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc110c25-3937-4fdc-bb1e-070e833c23f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:36.424967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc110c25-3937-4fdc-bb1e-070e833c23f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:36.425429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc110c25-3937-4fdc-bb1e-070e833c23f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:36.486420 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cc110c25-3937-4fdc-bb1e-070e833c23f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:36.493790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cc110c25-3937-4fdc-bb1e-070e833c23f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082117 Jun 20 06:24:36.494342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 508/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:36 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:37.511623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-80017df0-026b-4984-8305-bf9e6d743802 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:37.512417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-80017df0-026b-4984-8305-bf9e6d743802 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:37.515524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=42 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:37.520906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80017df0-026b-4984-8305-bf9e6d743802 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:37.521347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80017df0-026b-4984-8305-bf9e6d743802 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:37.522122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80017df0-026b-4984-8305-bf9e6d743802 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:37.522556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80017df0-026b-4984-8305-bf9e6d743802 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:37.586451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-80017df0-026b-4984-8305-bf9e6d743802 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:37.594708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-80017df0-026b-4984-8305-bf9e6d743802 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087254 Jun 20 06:24:37.595228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 523/1031] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:37 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:38.611541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ecf3519a-13ae-4c37-8db3-036054fc23f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:38.612123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ecf3519a-13ae-4c37-8db3-036054fc23f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:38.614391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=38 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:38.619818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecf3519a-13ae-4c37-8db3-036054fc23f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:38.620264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecf3519a-13ae-4c37-8db3-036054fc23f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:38.621026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecf3519a-13ae-4c37-8db3-036054fc23f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:38.621487 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ecf3519a-13ae-4c37-8db3-036054fc23f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:38.686309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ecf3519a-13ae-4c37-8db3-036054fc23f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:38.694117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ecf3519a-13ae-4c37-8db3-036054fc23f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086571 Jun 20 06:24:38.694671 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 509/1032] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:38 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:39.711193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2eafc7fc-6c29-46e9-810f-da1c5caf6dc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:39.711797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2eafc7fc-6c29-46e9-810f-da1c5caf6dc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:39.718465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2eafc7fc-6c29-46e9-810f-da1c5caf6dc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:39.718908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2eafc7fc-6c29-46e9-810f-da1c5caf6dc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:39.719664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2eafc7fc-6c29-46e9-810f-da1c5caf6dc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:39.720098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2eafc7fc-6c29-46e9-810f-da1c5caf6dc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:39.781076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2eafc7fc-6c29-46e9-810f-da1c5caf6dc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:39.788460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2eafc7fc-6c29-46e9-810f-da1c5caf6dc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081008 Jun 20 06:24:39.789013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 524/1033] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:39 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:40.805201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6f1db91f-0445-41d6-9d29-32c93e0f051e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:40.805834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6f1db91f-0445-41d6-9d29-32c93e0f051e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:40.812892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f1db91f-0445-41d6-9d29-32c93e0f051e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:40.813340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f1db91f-0445-41d6-9d29-32c93e0f051e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:40.814128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f1db91f-0445-41d6-9d29-32c93e0f051e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:40.814560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f1db91f-0445-41d6-9d29-32c93e0f051e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:40.874713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6f1db91f-0445-41d6-9d29-32c93e0f051e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:40.882116 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6f1db91f-0445-41d6-9d29-32c93e0f051e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080702 Jun 20 06:24:40.882680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 510/1034] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:40 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:41.898831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dada31ad-ce75-4203-9736-467c44528def tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:41.899443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dada31ad-ce75-4203-9736-467c44528def tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:41.906188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dada31ad-ce75-4203-9736-467c44528def tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:41.906646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dada31ad-ce75-4203-9736-467c44528def tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:41.907415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dada31ad-ce75-4203-9736-467c44528def tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:41.907855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dada31ad-ce75-4203-9736-467c44528def tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:41.972221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dada31ad-ce75-4203-9736-467c44528def tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:41.979711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dada31ad-ce75-4203-9736-467c44528def tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084742 Jun 20 06:24:41.980265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 525/1035] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:41 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:42.995955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-03f87c49-1653-41ec-b181-798c87072d82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:42.996563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-03f87c49-1653-41ec-b181-798c87072d82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:43.003774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03f87c49-1653-41ec-b181-798c87072d82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:43.004218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03f87c49-1653-41ec-b181-798c87072d82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:43.004975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03f87c49-1653-41ec-b181-798c87072d82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:43.005442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03f87c49-1653-41ec-b181-798c87072d82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:43.067144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-03f87c49-1653-41ec-b181-798c87072d82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:43.074511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-03f87c49-1653-41ec-b181-798c87072d82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082463 Jun 20 06:24:43.075065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 511/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:42 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:44.092042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a10c1454-f184-4a2d-bb41-bd6c80e00b49 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:44.092650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a10c1454-f184-4a2d-bb41-bd6c80e00b49 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:44.100966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a10c1454-f184-4a2d-bb41-bd6c80e00b49 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:44.101440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a10c1454-f184-4a2d-bb41-bd6c80e00b49 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:44.102207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a10c1454-f184-4a2d-bb41-bd6c80e00b49 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:44.102643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a10c1454-f184-4a2d-bb41-bd6c80e00b49 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:44.162753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a10c1454-f184-4a2d-bb41-bd6c80e00b49 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:44.170205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a10c1454-f184-4a2d-bb41-bd6c80e00b49 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082798 Jun 20 06:24:44.170759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 526/1037] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:44 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:45.187106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-32072c12-9a80-4539-ab68-af9750bc5b19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:45.187712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-32072c12-9a80-4539-ab68-af9750bc5b19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:45.194092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32072c12-9a80-4539-ab68-af9750bc5b19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:45.194538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32072c12-9a80-4539-ab68-af9750bc5b19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:45.195297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32072c12-9a80-4539-ab68-af9750bc5b19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:45.195726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32072c12-9a80-4539-ab68-af9750bc5b19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:45.198214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=92 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:45.257350 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-32072c12-9a80-4539-ab68-af9750bc5b19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:45.265398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-32072c12-9a80-4539-ab68-af9750bc5b19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082532 Jun 20 06:24:45.265961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 512/1038] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:45 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:46.282820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ec5e23a1-5e1a-4cd5-96b7-9983975e5496 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:46.283360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ec5e23a1-5e1a-4cd5-96b7-9983975e5496 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:46.289859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec5e23a1-5e1a-4cd5-96b7-9983975e5496 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:46.290311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec5e23a1-5e1a-4cd5-96b7-9983975e5496 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:46.291071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec5e23a1-5e1a-4cd5-96b7-9983975e5496 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:46.291503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec5e23a1-5e1a-4cd5-96b7-9983975e5496 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:46.355970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ec5e23a1-5e1a-4cd5-96b7-9983975e5496 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:46.364651 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ec5e23a1-5e1a-4cd5-96b7-9983975e5496 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086296 Jun 20 06:24:46.365176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 527/1039] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:46 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:47.380425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3f6f5d8d-3156-4b66-a719-678075d529bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:47.381029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3f6f5d8d-3156-4b66-a719-678075d529bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:47.387446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f6f5d8d-3156-4b66-a719-678075d529bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:47.388841 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f6f5d8d-3156-4b66-a719-678075d529bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:47.389660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f6f5d8d-3156-4b66-a719-678075d529bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:47.390098 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f6f5d8d-3156-4b66-a719-678075d529bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:47.449057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3f6f5d8d-3156-4b66-a719-678075d529bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:47.457043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3f6f5d8d-3156-4b66-a719-678075d529bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080487 Jun 20 06:24:47.457777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 513/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:47 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:48.473481 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2d8b9f79-4067-47f1-8a3c-1d7e61a3f6c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:48.474082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2d8b9f79-4067-47f1-8a3c-1d7e61a3f6c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:48.480474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d8b9f79-4067-47f1-8a3c-1d7e61a3f6c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:48.480915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d8b9f79-4067-47f1-8a3c-1d7e61a3f6c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:48.481881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d8b9f79-4067-47f1-8a3c-1d7e61a3f6c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:48.482302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2d8b9f79-4067-47f1-8a3c-1d7e61a3f6c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:48.543168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2d8b9f79-4067-47f1-8a3c-1d7e61a3f6c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:48.550607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2d8b9f79-4067-47f1-8a3c-1d7e61a3f6c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081029 Jun 20 06:24:48.551168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 528/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:48 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:49.567195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9061add2-0fac-4dc5-ad62-52135ee40f37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:49.567792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9061add2-0fac-4dc5-ad62-52135ee40f37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:49.574288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9061add2-0fac-4dc5-ad62-52135ee40f37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:49.574738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9061add2-0fac-4dc5-ad62-52135ee40f37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:49.575509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9061add2-0fac-4dc5-ad62-52135ee40f37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:49.575948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9061add2-0fac-4dc5-ad62-52135ee40f37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:49.639337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9061add2-0fac-4dc5-ad62-52135ee40f37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:49.647123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9061add2-0fac-4dc5-ad62-52135ee40f37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083812 Jun 20 06:24:49.647687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 514/1042] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:49 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:50.664090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-65b8f6a5-5e21-4fb6-bc57-d4ffd56c5700 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:50.664730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-65b8f6a5-5e21-4fb6-bc57-d4ffd56c5700 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:50.671866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65b8f6a5-5e21-4fb6-bc57-d4ffd56c5700 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:50.672313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65b8f6a5-5e21-4fb6-bc57-d4ffd56c5700 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:50.673078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65b8f6a5-5e21-4fb6-bc57-d4ffd56c5700 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:50.673550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65b8f6a5-5e21-4fb6-bc57-d4ffd56c5700 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:50.676033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=88 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:50.737591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-65b8f6a5-5e21-4fb6-bc57-d4ffd56c5700 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:50.744975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-65b8f6a5-5e21-4fb6-bc57-d4ffd56c5700 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084783 Jun 20 06:24:50.745572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 529/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:50 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:51.762003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-67b0278a-479a-44e5-80ea-bdd1c0a25981 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:51.763451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-67b0278a-479a-44e5-80ea-bdd1c0a25981 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:51.770368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67b0278a-479a-44e5-80ea-bdd1c0a25981 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:51.770812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67b0278a-479a-44e5-80ea-bdd1c0a25981 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:51.771572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67b0278a-479a-44e5-80ea-bdd1c0a25981 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:51.772007 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67b0278a-479a-44e5-80ea-bdd1c0a25981 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:51.833858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-67b0278a-479a-44e5-80ea-bdd1c0a25981 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:51.841864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-67b0278a-479a-44e5-80ea-bdd1c0a25981 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083695 Jun 20 06:24:51.842436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 515/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:51 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:52.858550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5bcfd35a-0a9b-477a-8f3c-2c4712abf3b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:52.859195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5bcfd35a-0a9b-477a-8f3c-2c4712abf3b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:52.865687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bcfd35a-0a9b-477a-8f3c-2c4712abf3b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:52.866130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bcfd35a-0a9b-477a-8f3c-2c4712abf3b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:52.866890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bcfd35a-0a9b-477a-8f3c-2c4712abf3b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:52.867318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bcfd35a-0a9b-477a-8f3c-2c4712abf3b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:52.936309 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5bcfd35a-0a9b-477a-8f3c-2c4712abf3b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:52.944685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5bcfd35a-0a9b-477a-8f3c-2c4712abf3b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.090097 Jun 20 06:24:52.945249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 530/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:52 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:53.962115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-811d63c3-37b5-42e9-8df5-e834d3cd1d8b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:53.962725 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-811d63c3-37b5-42e9-8df5-e834d3cd1d8b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:53.970200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-811d63c3-37b5-42e9-8df5-e834d3cd1d8b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:53.970651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-811d63c3-37b5-42e9-8df5-e834d3cd1d8b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:53.971417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-811d63c3-37b5-42e9-8df5-e834d3cd1d8b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:53.971849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-811d63c3-37b5-42e9-8df5-e834d3cd1d8b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:54.035633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-811d63c3-37b5-42e9-8df5-e834d3cd1d8b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:54.043233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-811d63c3-37b5-42e9-8df5-e834d3cd1d8b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084990 Jun 20 06:24:54.044538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 516/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:53 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:55.061339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c826a7a6-2b0c-4759-9366-4a01aae61941 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:55.062066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c826a7a6-2b0c-4759-9366-4a01aae61941 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:55.068664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c826a7a6-2b0c-4759-9366-4a01aae61941 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:55.069110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c826a7a6-2b0c-4759-9366-4a01aae61941 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:55.069896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c826a7a6-2b0c-4759-9366-4a01aae61941 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:55.070326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c826a7a6-2b0c-4759-9366-4a01aae61941 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:55.133810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c826a7a6-2b0c-4759-9366-4a01aae61941 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:55.141641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c826a7a6-2b0c-4759-9366-4a01aae61941 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085035 Jun 20 06:24:55.142202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 531/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:55 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:56.158438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-252b4d90-c4aa-4662-bd32-a74e203d83e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:56.159111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-252b4d90-c4aa-4662-bd32-a74e203d83e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:56.165486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-252b4d90-c4aa-4662-bd32-a74e203d83e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:56.165943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-252b4d90-c4aa-4662-bd32-a74e203d83e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:56.166717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-252b4d90-c4aa-4662-bd32-a74e203d83e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:56.167161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-252b4d90-c4aa-4662-bd32-a74e203d83e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:56.227825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-252b4d90-c4aa-4662-bd32-a74e203d83e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:56.235380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-252b4d90-c4aa-4662-bd32-a74e203d83e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081033 Jun 20 06:24:56.235941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 517/1048] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:56 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:57.252016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2fe14d66-f2c5-40a1-a64f-3d70e00f137a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:57.252616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2fe14d66-f2c5-40a1-a64f-3d70e00f137a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:57.258971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fe14d66-f2c5-40a1-a64f-3d70e00f137a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:57.259414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fe14d66-f2c5-40a1-a64f-3d70e00f137a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:57.260161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fe14d66-f2c5-40a1-a64f-3d70e00f137a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:57.260585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fe14d66-f2c5-40a1-a64f-3d70e00f137a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:57.321590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2fe14d66-f2c5-40a1-a64f-3d70e00f137a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:57.329564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2fe14d66-f2c5-40a1-a64f-3d70e00f137a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081435 Jun 20 06:24:57.330128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 532/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:57 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:58.345995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b7e336ae-f006-40ae-a79a-cfaecb35f125 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:58.346606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b7e336ae-f006-40ae-a79a-cfaecb35f125 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:58.353085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7e336ae-f006-40ae-a79a-cfaecb35f125 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:58.353572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7e336ae-f006-40ae-a79a-cfaecb35f125 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:58.354336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7e336ae-f006-40ae-a79a-cfaecb35f125 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:58.354771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7e336ae-f006-40ae-a79a-cfaecb35f125 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:58.415260 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b7e336ae-f006-40ae-a79a-cfaecb35f125 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:58.422687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b7e336ae-f006-40ae-a79a-cfaecb35f125 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080566 Jun 20 06:24:58.423252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 518/1050] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:58 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:59.439855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d8562561-e753-49e6-bce6-ff7e419ba716 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:59.440464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d8562561-e753-49e6-bce6-ff7e419ba716 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:59.446919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8562561-e753-49e6-bce6-ff7e419ba716 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:59.447370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8562561-e753-49e6-bce6-ff7e419ba716 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:59.448134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8562561-e753-49e6-bce6-ff7e419ba716 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:59.448567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8562561-e753-49e6-bce6-ff7e419ba716 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:59.512449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d8562561-e753-49e6-bce6-ff7e419ba716 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:59.520265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d8562561-e753-49e6-bce6-ff7e419ba716 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084910 Jun 20 06:24:59.521022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 533/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:59 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:00.537779 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b64a0531-7f43-4f84-bfa1-334fcf9a4777 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:00.538449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b64a0531-7f43-4f84-bfa1-334fcf9a4777 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:00.545245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b64a0531-7f43-4f84-bfa1-334fcf9a4777 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:00.545724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b64a0531-7f43-4f84-bfa1-334fcf9a4777 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:00.546568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b64a0531-7f43-4f84-bfa1-334fcf9a4777 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:00.546998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b64a0531-7f43-4f84-bfa1-334fcf9a4777 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:00.611822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b64a0531-7f43-4f84-bfa1-334fcf9a4777 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:00.619194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b64a0531-7f43-4f84-bfa1-334fcf9a4777 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085693 Jun 20 06:25:00.619749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 519/1052] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:00 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:01.636444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-469bcae1-5031-4d07-99ef-4184522d02b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:01.637156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-469bcae1-5031-4d07-99ef-4184522d02b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:01.644692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-469bcae1-5031-4d07-99ef-4184522d02b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:01.645196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-469bcae1-5031-4d07-99ef-4184522d02b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:01.645995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-469bcae1-5031-4d07-99ef-4184522d02b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:01.646426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-469bcae1-5031-4d07-99ef-4184522d02b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:01.710329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-469bcae1-5031-4d07-99ef-4184522d02b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:01.717847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-469bcae1-5031-4d07-99ef-4184522d02b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085221 Jun 20 06:25:01.718754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 534/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:01 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:02.735523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b3517f0c-1e1c-4520-a893-5c9632c6f263 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:02.736134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b3517f0c-1e1c-4520-a893-5c9632c6f263 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:02.742779 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3517f0c-1e1c-4520-a893-5c9632c6f263 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:02.744111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3517f0c-1e1c-4520-a893-5c9632c6f263 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:02.744954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3517f0c-1e1c-4520-a893-5c9632c6f263 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:02.745443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b3517f0c-1e1c-4520-a893-5c9632c6f263 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:02.817368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b3517f0c-1e1c-4520-a893-5c9632c6f263 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:02.824931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b3517f0c-1e1c-4520-a893-5c9632c6f263 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.093925 Jun 20 06:25:02.825509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 520/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:02 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:03.842581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d37f002-ea1e-49d1-93c6-557fa20f5b9b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:03.843207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6d37f002-ea1e-49d1-93c6-557fa20f5b9b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:03.849123 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d37f002-ea1e-49d1-93c6-557fa20f5b9b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:03.849609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d37f002-ea1e-49d1-93c6-557fa20f5b9b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:03.852953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d37f002-ea1e-49d1-93c6-557fa20f5b9b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:03.852953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d37f002-ea1e-49d1-93c6-557fa20f5b9b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:03.914918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6d37f002-ea1e-49d1-93c6-557fa20f5b9b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:03.923325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6d37f002-ea1e-49d1-93c6-557fa20f5b9b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084903 Jun 20 06:25:03.923900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 535/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:03 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:04.940641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2df5eb1f-bebc-446e-aba2-d5d875f6e339 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:04.941251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2df5eb1f-bebc-446e-aba2-d5d875f6e339 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:04.947851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2df5eb1f-bebc-446e-aba2-d5d875f6e339 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:04.948298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2df5eb1f-bebc-446e-aba2-d5d875f6e339 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:04.949067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2df5eb1f-bebc-446e-aba2-d5d875f6e339 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:04.949534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2df5eb1f-bebc-446e-aba2-d5d875f6e339 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:05.010869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2df5eb1f-bebc-446e-aba2-d5d875f6e339 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:05.018625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2df5eb1f-bebc-446e-aba2-d5d875f6e339 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082593 Jun 20 06:25:05.019200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 521/1056] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:04 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:06.034850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c4df6b34-d915-4bc8-b08b-0346072bf614 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:06.035450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c4df6b34-d915-4bc8-b08b-0346072bf614 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:06.041879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4df6b34-d915-4bc8-b08b-0346072bf614 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:06.042309 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4df6b34-d915-4bc8-b08b-0346072bf614 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:06.043060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4df6b34-d915-4bc8-b08b-0346072bf614 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:06.043490 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4df6b34-d915-4bc8-b08b-0346072bf614 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:06.103728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c4df6b34-d915-4bc8-b08b-0346072bf614 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:06.111338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c4df6b34-d915-4bc8-b08b-0346072bf614 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080614 Jun 20 06:25:06.111895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 536/1057] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:06 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:07.127873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-635753b9-8a1b-4abf-971d-ff0c5684b226 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:07.128501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-635753b9-8a1b-4abf-971d-ff0c5684b226 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:07.135439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-635753b9-8a1b-4abf-971d-ff0c5684b226 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:07.135890 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-635753b9-8a1b-4abf-971d-ff0c5684b226 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:07.136646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-635753b9-8a1b-4abf-971d-ff0c5684b226 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:07.137079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-635753b9-8a1b-4abf-971d-ff0c5684b226 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:07.200876 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-635753b9-8a1b-4abf-971d-ff0c5684b226 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:07.209322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-635753b9-8a1b-4abf-971d-ff0c5684b226 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085704 Jun 20 06:25:07.209911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 522/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:07 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:08.227061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-777f2fe5-69e5-4ef8-b073-176817be7753 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:08.227656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-777f2fe5-69e5-4ef8-b073-176817be7753 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:08.229931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:08.235518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-777f2fe5-69e5-4ef8-b073-176817be7753 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:08.235969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-777f2fe5-69e5-4ef8-b073-176817be7753 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:08.237339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-777f2fe5-69e5-4ef8-b073-176817be7753 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:08.237895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-777f2fe5-69e5-4ef8-b073-176817be7753 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:08.301480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-777f2fe5-69e5-4ef8-b073-176817be7753 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:08.308841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-777f2fe5-69e5-4ef8-b073-176817be7753 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085583 Jun 20 06:25:08.309405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 537/1059] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:08 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:09.325984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff38471e-605f-4932-900b-dfe578e68129 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:09.326506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff38471e-605f-4932-900b-dfe578e68129 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:09.328838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:09.334106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff38471e-605f-4932-900b-dfe578e68129 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:09.334557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff38471e-605f-4932-900b-dfe578e68129 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:09.335331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff38471e-605f-4932-900b-dfe578e68129 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:09.335773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff38471e-605f-4932-900b-dfe578e68129 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:09.397029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff38471e-605f-4932-900b-dfe578e68129 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:09.404475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff38471e-605f-4932-900b-dfe578e68129 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082450 Jun 20 06:25:09.405033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 523/1060] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:09 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:10.421298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-870e8dc1-4a1f-46b5-ae9e-0a046017f050 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:10.421975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-870e8dc1-4a1f-46b5-ae9e-0a046017f050 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:10.428462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-870e8dc1-4a1f-46b5-ae9e-0a046017f050 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:10.428905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-870e8dc1-4a1f-46b5-ae9e-0a046017f050 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:10.429765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-870e8dc1-4a1f-46b5-ae9e-0a046017f050 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:10.430200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-870e8dc1-4a1f-46b5-ae9e-0a046017f050 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:10.494573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-870e8dc1-4a1f-46b5-ae9e-0a046017f050 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:10.502638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-870e8dc1-4a1f-46b5-ae9e-0a046017f050 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085654 Jun 20 06:25:10.503207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 538/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:10 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:11.519840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-02cf4e49-e926-4618-a4ce-857a173b5ba3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:11.520381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-02cf4e49-e926-4618-a4ce-857a173b5ba3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:11.526903 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02cf4e49-e926-4618-a4ce-857a173b5ba3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:11.527356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02cf4e49-e926-4618-a4ce-857a173b5ba3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:11.528121 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02cf4e49-e926-4618-a4ce-857a173b5ba3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:11.528605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02cf4e49-e926-4618-a4ce-857a173b5ba3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:11.589094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-02cf4e49-e926-4618-a4ce-857a173b5ba3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:11.597211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-02cf4e49-e926-4618-a4ce-857a173b5ba3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081523 Jun 20 06:25:11.597798 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 524/1062] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:11 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:12.614508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-217e8b3a-909a-4b6a-990c-4c48f3ffed88 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:12.615040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-217e8b3a-909a-4b6a-990c-4c48f3ffed88 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:12.621680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-217e8b3a-909a-4b6a-990c-4c48f3ffed88 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:12.622133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-217e8b3a-909a-4b6a-990c-4c48f3ffed88 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:12.622900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-217e8b3a-909a-4b6a-990c-4c48f3ffed88 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:12.623339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-217e8b3a-909a-4b6a-990c-4c48f3ffed88 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:12.686261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-217e8b3a-909a-4b6a-990c-4c48f3ffed88 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:12.693764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-217e8b3a-909a-4b6a-990c-4c48f3ffed88 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083208 Jun 20 06:25:12.694319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 539/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:12 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:13.710447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8fd2f8ce-4c15-41a3-a244-f491dec7c93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:13.711051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8fd2f8ce-4c15-41a3-a244-f491dec7c93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:13.717641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fd2f8ce-4c15-41a3-a244-f491dec7c93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:13.718088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fd2f8ce-4c15-41a3-a244-f491dec7c93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:13.718878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fd2f8ce-4c15-41a3-a244-f491dec7c93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:13.719584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fd2f8ce-4c15-41a3-a244-f491dec7c93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:13.779526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8fd2f8ce-4c15-41a3-a244-f491dec7c93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:13.787114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8fd2f8ce-4c15-41a3-a244-f491dec7c93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080491 Jun 20 06:25:13.787673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 525/1064] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:13 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:14.805273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58cfd090-a388-49f2-81a4-6c42e872348f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:14.805912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-58cfd090-a388-49f2-81a4-6c42e872348f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:14.812371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58cfd090-a388-49f2-81a4-6c42e872348f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:14.813367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58cfd090-a388-49f2-81a4-6c42e872348f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:14.814245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58cfd090-a388-49f2-81a4-6c42e872348f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:14.814683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58cfd090-a388-49f2-81a4-6c42e872348f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:14.874729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-58cfd090-a388-49f2-81a4-6c42e872348f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:14.882531 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-58cfd090-a388-49f2-81a4-6c42e872348f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081098 Jun 20 06:25:14.883092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 540/1065] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:14 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:15.899926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-52dee745-6a65-426a-a942-5266f7c6d043 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:15.901028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-52dee745-6a65-426a-a942-5266f7c6d043 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:15.909228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52dee745-6a65-426a-a942-5266f7c6d043 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:15.909717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52dee745-6a65-426a-a942-5266f7c6d043 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:15.910502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52dee745-6a65-426a-a942-5266f7c6d043 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:15.910949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52dee745-6a65-426a-a942-5266f7c6d043 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:15.913597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:15.979159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-52dee745-6a65-426a-a942-5266f7c6d043 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:15.987868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-52dee745-6a65-426a-a942-5266f7c6d043 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.091799 Jun 20 06:25:15.988436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 526/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:15 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:17.005086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d581b1f8-2a6b-4098-92bd-4986651e6868 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:17.005733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d581b1f8-2a6b-4098-92bd-4986651e6868 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:17.012112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d581b1f8-2a6b-4098-92bd-4986651e6868 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:17.012565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d581b1f8-2a6b-4098-92bd-4986651e6868 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:17.013321 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d581b1f8-2a6b-4098-92bd-4986651e6868 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:17.013779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d581b1f8-2a6b-4098-92bd-4986651e6868 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:17.077045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d581b1f8-2a6b-4098-92bd-4986651e6868 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:17.085262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d581b1f8-2a6b-4098-92bd-4986651e6868 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084666 Jun 20 06:25:17.085858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 541/1067] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:16 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:18.101235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3c459ad8-959a-42f6-bc8d-a371b0512830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:18.101881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3c459ad8-959a-42f6-bc8d-a371b0512830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:18.108346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c459ad8-959a-42f6-bc8d-a371b0512830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:18.108797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c459ad8-959a-42f6-bc8d-a371b0512830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:18.109666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c459ad8-959a-42f6-bc8d-a371b0512830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:18.110103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c459ad8-959a-42f6-bc8d-a371b0512830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:18.170467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3c459ad8-959a-42f6-bc8d-a371b0512830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:18.178560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3c459ad8-959a-42f6-bc8d-a371b0512830 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081191 Jun 20 06:25:18.179131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 527/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:18 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:19.195470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-60fccf49-fcac-424f-bd77-b96e03ab93c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:19.196109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-60fccf49-fcac-424f-bd77-b96e03ab93c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:19.202548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-60fccf49-fcac-424f-bd77-b96e03ab93c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:19.202995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-60fccf49-fcac-424f-bd77-b96e03ab93c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:19.203753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-60fccf49-fcac-424f-bd77-b96e03ab93c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:19.204796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-60fccf49-fcac-424f-bd77-b96e03ab93c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:19.266271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-60fccf49-fcac-424f-bd77-b96e03ab93c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:19.274500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-60fccf49-fcac-424f-bd77-b96e03ab93c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083205 Jun 20 06:25:19.275058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 542/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:19 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:20.291097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b0e73889-cac4-48ab-9cb6-3ab43f6980f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:20.291739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b0e73889-cac4-48ab-9cb6-3ab43f6980f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:20.298839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0e73889-cac4-48ab-9cb6-3ab43f6980f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:20.299288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0e73889-cac4-48ab-9cb6-3ab43f6980f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:20.300052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0e73889-cac4-48ab-9cb6-3ab43f6980f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:20.300482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0e73889-cac4-48ab-9cb6-3ab43f6980f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:20.381999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b0e73889-cac4-48ab-9cb6-3ab43f6980f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:20.390133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b0e73889-cac4-48ab-9cb6-3ab43f6980f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.102861 Jun 20 06:25:20.390699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 528/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:20 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:21.406926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e3757fb8-ae7e-40d9-abde-31572a5368af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:21.408211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e3757fb8-ae7e-40d9-abde-31572a5368af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:21.414718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3757fb8-ae7e-40d9-abde-31572a5368af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:21.415168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3757fb8-ae7e-40d9-abde-31572a5368af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:21.415924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3757fb8-ae7e-40d9-abde-31572a5368af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:21.416358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3757fb8-ae7e-40d9-abde-31572a5368af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:21.418873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:21.480487 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e3757fb8-ae7e-40d9-abde-31572a5368af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:21.488283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e3757fb8-ae7e-40d9-abde-31572a5368af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085230 Jun 20 06:25:21.488851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 543/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:21 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:22.504669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8d06ecf5-2ed6-40c1-b716-6b481dce6407 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:22.505216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8d06ecf5-2ed6-40c1-b716-6b481dce6407 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:22.511749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8d06ecf5-2ed6-40c1-b716-6b481dce6407 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:22.512206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8d06ecf5-2ed6-40c1-b716-6b481dce6407 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:22.512978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8d06ecf5-2ed6-40c1-b716-6b481dce6407 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:22.513451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8d06ecf5-2ed6-40c1-b716-6b481dce6407 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:22.579196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8d06ecf5-2ed6-40c1-b716-6b481dce6407 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:22.587526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8d06ecf5-2ed6-40c1-b716-6b481dce6407 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087216 Jun 20 06:25:22.588096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 529/1072] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:22 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:23.605332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-37e19309-1ed9-47e9-a8f2-1162a70578b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:23.605910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-37e19309-1ed9-47e9-a8f2-1162a70578b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:23.612904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37e19309-1ed9-47e9-a8f2-1162a70578b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:23.613349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37e19309-1ed9-47e9-a8f2-1162a70578b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:23.614135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37e19309-1ed9-47e9-a8f2-1162a70578b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:23.614564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37e19309-1ed9-47e9-a8f2-1162a70578b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:23.674851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-37e19309-1ed9-47e9-a8f2-1162a70578b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:23.682233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-37e19309-1ed9-47e9-a8f2-1162a70578b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080835 Jun 20 06:25:23.682791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 544/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:23 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:24.698263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2dc5d517-d993-4f8e-9eeb-c30442786051 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:24.698873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2dc5d517-d993-4f8e-9eeb-c30442786051 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:24.705523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2dc5d517-d993-4f8e-9eeb-c30442786051 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:24.705972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2dc5d517-d993-4f8e-9eeb-c30442786051 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:24.706743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2dc5d517-d993-4f8e-9eeb-c30442786051 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:24.707180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2dc5d517-d993-4f8e-9eeb-c30442786051 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:24.767757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2dc5d517-d993-4f8e-9eeb-c30442786051 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:24.776169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2dc5d517-d993-4f8e-9eeb-c30442786051 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081814 Jun 20 06:25:24.776738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 530/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:24 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:25.793406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4d3b59ef-2fb6-4f89-b797-513d1d387b4a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:25.794021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4d3b59ef-2fb6-4f89-b797-513d1d387b4a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:25.801801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d3b59ef-2fb6-4f89-b797-513d1d387b4a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:25.802279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d3b59ef-2fb6-4f89-b797-513d1d387b4a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:25.803055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d3b59ef-2fb6-4f89-b797-513d1d387b4a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:25.803497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d3b59ef-2fb6-4f89-b797-513d1d387b4a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:25.869325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4d3b59ef-2fb6-4f89-b797-513d1d387b4a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:25.877318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4d3b59ef-2fb6-4f89-b797-513d1d387b4a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087808 Jun 20 06:25:25.878083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 545/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:25 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:26.895429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-81d34277-a0df-41f3-a857-215873a0341e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:26.896053 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-81d34277-a0df-41f3-a857-215873a0341e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:26.902731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d34277-a0df-41f3-a857-215873a0341e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:26.903188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d34277-a0df-41f3-a857-215873a0341e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:26.903961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d34277-a0df-41f3-a857-215873a0341e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:26.904401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d34277-a0df-41f3-a857-215873a0341e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:26.967081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-81d34277-a0df-41f3-a857-215873a0341e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:26.975076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-81d34277-a0df-41f3-a857-215873a0341e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084900 Jun 20 06:25:26.975641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 531/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:26 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:27.991660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-37822e4f-29bf-4352-b70a-9cdc44f685f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:27.992279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-37822e4f-29bf-4352-b70a-9cdc44f685f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:27.998740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37822e4f-29bf-4352-b70a-9cdc44f685f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:27.999196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37822e4f-29bf-4352-b70a-9cdc44f685f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:27.999962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37822e4f-29bf-4352-b70a-9cdc44f685f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:28.000403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37822e4f-29bf-4352-b70a-9cdc44f685f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:28.061738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-37822e4f-29bf-4352-b70a-9cdc44f685f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:28.069397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-37822e4f-29bf-4352-b70a-9cdc44f685f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081623 Jun 20 06:25:28.069961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 546/1077] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:27 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:29.085752 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c9bac5b9-673c-4259-8804-d6545795123d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:29.086373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c9bac5b9-673c-4259-8804-d6545795123d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:29.093069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9bac5b9-673c-4259-8804-d6545795123d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:29.093565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9bac5b9-673c-4259-8804-d6545795123d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:29.094350 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9bac5b9-673c-4259-8804-d6545795123d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:29.094790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9bac5b9-673c-4259-8804-d6545795123d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:29.156590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c9bac5b9-673c-4259-8804-d6545795123d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:29.164829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c9bac5b9-673c-4259-8804-d6545795123d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082893 Jun 20 06:25:29.165421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 532/1078] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:29 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:30.181369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-13f7df5d-344a-4b4a-8449-6ab41804b4f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:30.181996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-13f7df5d-344a-4b4a-8449-6ab41804b4f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:30.188381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13f7df5d-344a-4b4a-8449-6ab41804b4f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:30.188924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13f7df5d-344a-4b4a-8449-6ab41804b4f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:30.189720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13f7df5d-344a-4b4a-8449-6ab41804b4f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:30.190842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13f7df5d-344a-4b4a-8449-6ab41804b4f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:30.254702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-13f7df5d-344a-4b4a-8449-6ab41804b4f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:30.262301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-13f7df5d-344a-4b4a-8449-6ab41804b4f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084738 Jun 20 06:25:30.262859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 547/1079] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:30 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:31.279812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a12ac69e-45e6-453c-a48c-32f054bede2a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:31.280427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a12ac69e-45e6-453c-a48c-32f054bede2a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:31.287401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a12ac69e-45e6-453c-a48c-32f054bede2a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:31.287853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a12ac69e-45e6-453c-a48c-32f054bede2a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:31.288614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a12ac69e-45e6-453c-a48c-32f054bede2a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:31.289055 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a12ac69e-45e6-453c-a48c-32f054bede2a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:31.354069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a12ac69e-45e6-453c-a48c-32f054bede2a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:31.361626 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a12ac69e-45e6-453c-a48c-32f054bede2a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085624 Jun 20 06:25:31.362892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 533/1080] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:31 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:32.379423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-719ca43b-a966-42e0-9007-ed4c9205973a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:32.380033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-719ca43b-a966-42e0-9007-ed4c9205973a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:32.387023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-719ca43b-a966-42e0-9007-ed4c9205973a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:32.387023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-719ca43b-a966-42e0-9007-ed4c9205973a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:32.387719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-719ca43b-a966-42e0-9007-ed4c9205973a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:32.388149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-719ca43b-a966-42e0-9007-ed4c9205973a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:32.456489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-719ca43b-a966-42e0-9007-ed4c9205973a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:32.463882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-719ca43b-a966-42e0-9007-ed4c9205973a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.088884 Jun 20 06:25:32.464742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 548/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:32 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:33.480223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8e48a292-a41a-4e71-8c60-2bb58eca2ba2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:33.480777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8e48a292-a41a-4e71-8c60-2bb58eca2ba2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:33.487319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e48a292-a41a-4e71-8c60-2bb58eca2ba2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:33.487773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e48a292-a41a-4e71-8c60-2bb58eca2ba2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:33.488538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e48a292-a41a-4e71-8c60-2bb58eca2ba2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:33.488976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e48a292-a41a-4e71-8c60-2bb58eca2ba2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:33.548857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8e48a292-a41a-4e71-8c60-2bb58eca2ba2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:33.556522 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8e48a292-a41a-4e71-8c60-2bb58eca2ba2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080320 Jun 20 06:25:33.557082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 534/1082] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:33 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:34.573818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-05ab54f0-1788-4fb3-a748-5f5dfd6478e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:34.574369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-05ab54f0-1788-4fb3-a748-5f5dfd6478e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:34.580371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05ab54f0-1788-4fb3-a748-5f5dfd6478e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:34.580812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05ab54f0-1788-4fb3-a748-5f5dfd6478e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:34.582100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05ab54f0-1788-4fb3-a748-5f5dfd6478e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:34.582525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05ab54f0-1788-4fb3-a748-5f5dfd6478e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:34.644775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-05ab54f0-1788-4fb3-a748-5f5dfd6478e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:34.652210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-05ab54f0-1788-4fb3-a748-5f5dfd6478e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082525 Jun 20 06:25:34.652768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 549/1083] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:34 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:35.670073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1020355c-b67b-433c-85d5-b3d66f277473 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:35.670681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1020355c-b67b-433c-85d5-b3d66f277473 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:35.678196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1020355c-b67b-433c-85d5-b3d66f277473 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:35.678641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1020355c-b67b-433c-85d5-b3d66f277473 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:35.679418 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1020355c-b67b-433c-85d5-b3d66f277473 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:35.679850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1020355c-b67b-433c-85d5-b3d66f277473 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:35.740102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1020355c-b67b-433c-85d5-b3d66f277473 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:35.747544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1020355c-b67b-433c-85d5-b3d66f277473 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081347 Jun 20 06:25:35.748096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 535/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:35 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:36.763970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fa48c55a-fb28-4df8-aa5b-760127a117f2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:36.764586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fa48c55a-fb28-4df8-aa5b-760127a117f2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:36.771943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa48c55a-fb28-4df8-aa5b-760127a117f2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:36.772396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa48c55a-fb28-4df8-aa5b-760127a117f2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:36.773165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa48c55a-fb28-4df8-aa5b-760127a117f2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:36.773627 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa48c55a-fb28-4df8-aa5b-760127a117f2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:36.833640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fa48c55a-fb28-4df8-aa5b-760127a117f2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:36.841012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fa48c55a-fb28-4df8-aa5b-760127a117f2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080897 Jun 20 06:25:36.841608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 550/1085] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:36 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:37.858391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-826d959b-816f-49ed-944a-7ec86848da9e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:37.859004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-826d959b-816f-49ed-944a-7ec86848da9e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:37.866532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-826d959b-816f-49ed-944a-7ec86848da9e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:37.866981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-826d959b-816f-49ed-944a-7ec86848da9e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:37.867748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-826d959b-816f-49ed-944a-7ec86848da9e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:37.868213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-826d959b-816f-49ed-944a-7ec86848da9e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:37.932960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-826d959b-816f-49ed-944a-7ec86848da9e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:37.942659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-826d959b-816f-49ed-944a-7ec86848da9e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.088117 Jun 20 06:25:37.943432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 536/1086] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:37 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:38.960281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a0a17cc9-9a43-453c-b059-30b71f1e0f1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:38.960869 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a0a17cc9-9a43-453c-b059-30b71f1e0f1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:38.963169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:38.968457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0a17cc9-9a43-453c-b059-30b71f1e0f1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:38.968899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0a17cc9-9a43-453c-b059-30b71f1e0f1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:38.969687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0a17cc9-9a43-453c-b059-30b71f1e0f1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:38.970117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a0a17cc9-9a43-453c-b059-30b71f1e0f1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:39.033135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a0a17cc9-9a43-453c-b059-30b71f1e0f1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:39.040627 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a0a17cc9-9a43-453c-b059-30b71f1e0f1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084761 Jun 20 06:25:39.041184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 551/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:38 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:40.057623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3cf22e22-6259-4df8-8f63-0132b11587f7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:40.058258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3cf22e22-6259-4df8-8f63-0132b11587f7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:40.060664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:40.067366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3cf22e22-6259-4df8-8f63-0132b11587f7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:40.067830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3cf22e22-6259-4df8-8f63-0132b11587f7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:40.068603 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3cf22e22-6259-4df8-8f63-0132b11587f7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:40.069042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3cf22e22-6259-4df8-8f63-0132b11587f7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:40.130270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3cf22e22-6259-4df8-8f63-0132b11587f7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:40.137630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3cf22e22-6259-4df8-8f63-0132b11587f7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083975 Jun 20 06:25:40.138200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 537/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:40 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:41.298585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-48c754b0-eda8-467d-9c3e-bfe708fabc5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:41.299195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-48c754b0-eda8-467d-9c3e-bfe708fabc5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:41.305698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48c754b0-eda8-467d-9c3e-bfe708fabc5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:41.306141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48c754b0-eda8-467d-9c3e-bfe708fabc5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:41.306887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48c754b0-eda8-467d-9c3e-bfe708fabc5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:41.307316 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48c754b0-eda8-467d-9c3e-bfe708fabc5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:41.367604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-48c754b0-eda8-467d-9c3e-bfe708fabc5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:41.374892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-48c754b0-eda8-467d-9c3e-bfe708fabc5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.223528 Jun 20 06:25:41.375451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 552/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:41 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:42.392397 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e9878939-2629-4063-b94e-46168d72b96f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:42.393017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9878939-2629-4063-b94e-46168d72b96f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:42.399766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9878939-2629-4063-b94e-46168d72b96f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:42.400221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9878939-2629-4063-b94e-46168d72b96f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:42.400984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9878939-2629-4063-b94e-46168d72b96f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:42.401450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9878939-2629-4063-b94e-46168d72b96f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:42.462095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e9878939-2629-4063-b94e-46168d72b96f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:42.473778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e9878939-2629-4063-b94e-46168d72b96f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085554 Jun 20 06:25:42.474416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 538/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:42 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:43.490437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e9332551-f7a7-4a54-84de-81560b990663 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:43.491083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e9332551-f7a7-4a54-84de-81560b990663 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:43.497621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9332551-f7a7-4a54-84de-81560b990663 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:43.498073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9332551-f7a7-4a54-84de-81560b990663 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:43.498837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9332551-f7a7-4a54-84de-81560b990663 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:43.499275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9332551-f7a7-4a54-84de-81560b990663 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:43.563755 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e9332551-f7a7-4a54-84de-81560b990663 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:43.572147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e9332551-f7a7-4a54-84de-81560b990663 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085669 Jun 20 06:25:43.572712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 553/1091] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:43 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:44.593969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f8ba5935-7e21-45c7-8b46-8b021c8b260e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:44.594508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f8ba5935-7e21-45c7-8b46-8b021c8b260e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:44.601151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8ba5935-7e21-45c7-8b46-8b021c8b260e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:44.601633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8ba5935-7e21-45c7-8b46-8b021c8b260e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:44.602388 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8ba5935-7e21-45c7-8b46-8b021c8b260e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:44.602819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8ba5935-7e21-45c7-8b46-8b021c8b260e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:44.662482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f8ba5935-7e21-45c7-8b46-8b021c8b260e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:44.670106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f8ba5935-7e21-45c7-8b46-8b021c8b260e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080367 Jun 20 06:25:44.670669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 539/1092] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:44 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:45.686858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-de147343-6814-4421-b075-b3a71ef2a2ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:45.687481 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-de147343-6814-4421-b075-b3a71ef2a2ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:45.694567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-de147343-6814-4421-b075-b3a71ef2a2ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:45.695027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-de147343-6814-4421-b075-b3a71ef2a2ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:45.695796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-de147343-6814-4421-b075-b3a71ef2a2ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:45.696237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-de147343-6814-4421-b075-b3a71ef2a2ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:45.758648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-de147343-6814-4421-b075-b3a71ef2a2ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:45.766063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-de147343-6814-4421-b075-b3a71ef2a2ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083106 Jun 20 06:25:45.774739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 554/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:45 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:46.783399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bd886d1-6c30-4c2e-a28b-ab2494cdb6a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:46.784067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7bd886d1-6c30-4c2e-a28b-ab2494cdb6a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:46.791333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bd886d1-6c30-4c2e-a28b-ab2494cdb6a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:46.791786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bd886d1-6c30-4c2e-a28b-ab2494cdb6a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:46.792566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bd886d1-6c30-4c2e-a28b-ab2494cdb6a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:46.793012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bd886d1-6c30-4c2e-a28b-ab2494cdb6a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:46.795681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:46.857830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bd886d1-6c30-4c2e-a28b-ab2494cdb6a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:46.865947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bd886d1-6c30-4c2e-a28b-ab2494cdb6a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086440 Jun 20 06:25:46.866519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 540/1094] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:46 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:47.883323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-438d364a-f807-4391-a728-c27a4d344383 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:47.883940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-438d364a-f807-4391-a728-c27a4d344383 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:47.890356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-438d364a-f807-4391-a728-c27a4d344383 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:47.890938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-438d364a-f807-4391-a728-c27a4d344383 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:47.891721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-438d364a-f807-4391-a728-c27a4d344383 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:47.892358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-438d364a-f807-4391-a728-c27a4d344383 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:47.954674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-438d364a-f807-4391-a728-c27a4d344383 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:47.963161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-438d364a-f807-4391-a728-c27a4d344383 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084675 Jun 20 06:25:47.963733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 555/1095] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:47 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:48.979708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6b9973a0-afb6-4daa-8f5a-eda31c8cc63e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:48.980301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6b9973a0-afb6-4daa-8f5a-eda31c8cc63e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:48.986725 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b9973a0-afb6-4daa-8f5a-eda31c8cc63e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:48.987174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b9973a0-afb6-4daa-8f5a-eda31c8cc63e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:48.988137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b9973a0-afb6-4daa-8f5a-eda31c8cc63e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:48.988541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b9973a0-afb6-4daa-8f5a-eda31c8cc63e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:49.048747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6b9973a0-afb6-4daa-8f5a-eda31c8cc63e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:49.056493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6b9973a0-afb6-4daa-8f5a-eda31c8cc63e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080647 Jun 20 06:25:49.057054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 541/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:48 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:50.073037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-aaed53e1-34e5-4974-9b57-83a602effa47 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:50.073685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-aaed53e1-34e5-4974-9b57-83a602effa47 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:50.080721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aaed53e1-34e5-4974-9b57-83a602effa47 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:50.081166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aaed53e1-34e5-4974-9b57-83a602effa47 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:50.082213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aaed53e1-34e5-4974-9b57-83a602effa47 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:50.082645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aaed53e1-34e5-4974-9b57-83a602effa47 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:50.147218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-aaed53e1-34e5-4974-9b57-83a602effa47 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:50.154716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-aaed53e1-34e5-4974-9b57-83a602effa47 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085618 Jun 20 06:25:50.155280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 556/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:50 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:51.171757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e6b2dc51-8374-4716-a6c1-8db925b9816d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:51.172362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e6b2dc51-8374-4716-a6c1-8db925b9816d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:51.178912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6b2dc51-8374-4716-a6c1-8db925b9816d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:51.179353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6b2dc51-8374-4716-a6c1-8db925b9816d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:51.180109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6b2dc51-8374-4716-a6c1-8db925b9816d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:51.180539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6b2dc51-8374-4716-a6c1-8db925b9816d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:51.240150 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6b2dc51-8374-4716-a6c1-8db925b9816d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:51.247551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e6b2dc51-8374-4716-a6c1-8db925b9816d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.079585 Jun 20 06:25:51.248113 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 542/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:51 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:52.264068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-709eb89e-4b02-4f7e-bbae-2243a9ab8b6e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:52.264678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-709eb89e-4b02-4f7e-bbae-2243a9ab8b6e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:52.271533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-709eb89e-4b02-4f7e-bbae-2243a9ab8b6e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:52.271976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-709eb89e-4b02-4f7e-bbae-2243a9ab8b6e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:52.272725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-709eb89e-4b02-4f7e-bbae-2243a9ab8b6e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:52.273155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-709eb89e-4b02-4f7e-bbae-2243a9ab8b6e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:52.275649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:52.337791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-709eb89e-4b02-4f7e-bbae-2243a9ab8b6e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:52.345250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-709eb89e-4b02-4f7e-bbae-2243a9ab8b6e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085011 Jun 20 06:25:52.345833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 557/1099] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:52 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:53.363754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a6fc2463-e5b5-4fca-9a77-3cb2a3e2826f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:53.364357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a6fc2463-e5b5-4fca-9a77-3cb2a3e2826f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:53.370815 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a6fc2463-e5b5-4fca-9a77-3cb2a3e2826f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:53.371263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a6fc2463-e5b5-4fca-9a77-3cb2a3e2826f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:53.372015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a6fc2463-e5b5-4fca-9a77-3cb2a3e2826f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:53.372450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a6fc2463-e5b5-4fca-9a77-3cb2a3e2826f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:53.436074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a6fc2463-e5b5-4fca-9a77-3cb2a3e2826f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:53.444303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a6fc2463-e5b5-4fca-9a77-3cb2a3e2826f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085075 Jun 20 06:25:53.444865 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 543/1100] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:53 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:54.461242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f8d100e-a12b-4ae5-b6b9-515a3e30bfcd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:54.461910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f8d100e-a12b-4ae5-b6b9-515a3e30bfcd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:54.468384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f8d100e-a12b-4ae5-b6b9-515a3e30bfcd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:54.468836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f8d100e-a12b-4ae5-b6b9-515a3e30bfcd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:54.469626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f8d100e-a12b-4ae5-b6b9-515a3e30bfcd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:54.470063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f8d100e-a12b-4ae5-b6b9-515a3e30bfcd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:54.530857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7f8d100e-a12b-4ae5-b6b9-515a3e30bfcd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:54.539030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f8d100e-a12b-4ae5-b6b9-515a3e30bfcd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081614 Jun 20 06:25:54.539590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 558/1101] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:54 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:55.556198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e9a10da6-b994-4995-b057-05cfce3d1526 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:55.556907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9a10da6-b994-4995-b057-05cfce3d1526 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:55.563176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9a10da6-b994-4995-b057-05cfce3d1526 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:55.563618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9a10da6-b994-4995-b057-05cfce3d1526 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:55.564375 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9a10da6-b994-4995-b057-05cfce3d1526 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:55.564806 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9a10da6-b994-4995-b057-05cfce3d1526 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:55.624645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e9a10da6-b994-4995-b057-05cfce3d1526 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:55.632321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e9a10da6-b994-4995-b057-05cfce3d1526 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080071 Jun 20 06:25:55.632892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 544/1102] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:55 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:56.649856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-11cc4629-d47d-40e8-9616-e471f9245e79 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:56.650464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-11cc4629-d47d-40e8-9616-e471f9245e79 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:56.656898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-11cc4629-d47d-40e8-9616-e471f9245e79 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:56.657342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-11cc4629-d47d-40e8-9616-e471f9245e79 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:56.658116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-11cc4629-d47d-40e8-9616-e471f9245e79 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:56.658549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-11cc4629-d47d-40e8-9616-e471f9245e79 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:56.721656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-11cc4629-d47d-40e8-9616-e471f9245e79 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:56.729047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-11cc4629-d47d-40e8-9616-e471f9245e79 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082992 Jun 20 06:25:56.729643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 559/1103] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:56 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:57.745827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a9639511-aa7d-4d7f-9a75-ee948d8d68f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:57.746433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a9639511-aa7d-4d7f-9a75-ee948d8d68f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:57.752815 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9639511-aa7d-4d7f-9a75-ee948d8d68f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:57.753788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9639511-aa7d-4d7f-9a75-ee948d8d68f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:57.754536 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9639511-aa7d-4d7f-9a75-ee948d8d68f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:57.754965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9639511-aa7d-4d7f-9a75-ee948d8d68f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:57.815058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a9639511-aa7d-4d7f-9a75-ee948d8d68f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:57.822986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a9639511-aa7d-4d7f-9a75-ee948d8d68f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081130 Jun 20 06:25:57.823539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 545/1104] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:57 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:58.839809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-aadfde93-2a0b-4070-997b-62b89632952d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:58.840421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-aadfde93-2a0b-4070-997b-62b89632952d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:58.847715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aadfde93-2a0b-4070-997b-62b89632952d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:58.848120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aadfde93-2a0b-4070-997b-62b89632952d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:58.848875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aadfde93-2a0b-4070-997b-62b89632952d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:58.849312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aadfde93-2a0b-4070-997b-62b89632952d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:58.908828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-aadfde93-2a0b-4070-997b-62b89632952d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:58.916903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-aadfde93-2a0b-4070-997b-62b89632952d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080965 Jun 20 06:25:58.917478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 560/1105] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:58 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:59.933599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d4fcaaff-f24a-47eb-ae51-a950818708c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:59.934203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d4fcaaff-f24a-47eb-ae51-a950818708c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:59.940628 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4fcaaff-f24a-47eb-ae51-a950818708c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:59.941075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4fcaaff-f24a-47eb-ae51-a950818708c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:59.941855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4fcaaff-f24a-47eb-ae51-a950818708c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:59.942291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4fcaaff-f24a-47eb-ae51-a950818708c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:00.003768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d4fcaaff-f24a-47eb-ae51-a950818708c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:00.011177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d4fcaaff-f24a-47eb-ae51-a950818708c1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081453 Jun 20 06:26:00.011734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 546/1106] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:59 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:01.029334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-785a70c1-53ef-499a-adbd-8f64068109ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:01.029974 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-785a70c1-53ef-499a-adbd-8f64068109ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:01.036489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-785a70c1-53ef-499a-adbd-8f64068109ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:01.036936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-785a70c1-53ef-499a-adbd-8f64068109ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:01.037731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-785a70c1-53ef-499a-adbd-8f64068109ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:01.038170 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-785a70c1-53ef-499a-adbd-8f64068109ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:01.102244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-785a70c1-53ef-499a-adbd-8f64068109ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:01.109660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-785a70c1-53ef-499a-adbd-8f64068109ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084203 Jun 20 06:26:01.110218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 561/1107] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:01 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:02.126636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1101328f-a0f2-46e0-b48b-ed0e117639c2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:02.127224 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1101328f-a0f2-46e0-b48b-ed0e117639c2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:02.134384 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1101328f-a0f2-46e0-b48b-ed0e117639c2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:02.134842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1101328f-a0f2-46e0-b48b-ed0e117639c2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:02.135610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1101328f-a0f2-46e0-b48b-ed0e117639c2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:02.136049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1101328f-a0f2-46e0-b48b-ed0e117639c2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:02.197680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1101328f-a0f2-46e0-b48b-ed0e117639c2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:02.211271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1101328f-a0f2-46e0-b48b-ed0e117639c2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.088394 Jun 20 06:26:02.211858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 547/1108] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:02 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:26:03.228991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-78b89206-8fe6-403a-87fe-b4e6f5d3f634 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:03.229638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-78b89206-8fe6-403a-87fe-b4e6f5d3f634 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:03.235760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78b89206-8fe6-403a-87fe-b4e6f5d3f634 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:03.236201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78b89206-8fe6-403a-87fe-b4e6f5d3f634 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:03.236955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78b89206-8fe6-403a-87fe-b4e6f5d3f634 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:03.237710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78b89206-8fe6-403a-87fe-b4e6f5d3f634 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:03.299645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-78b89206-8fe6-403a-87fe-b4e6f5d3f634 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:03.307120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-78b89206-8fe6-403a-87fe-b4e6f5d3f634 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082017 Jun 20 06:26:03.307684 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 562/1109] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:03 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:04.324031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d583f636-0fdc-499e-b678-d90b4d72b45b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:04.324637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d583f636-0fdc-499e-b678-d90b4d72b45b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:04.332480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d583f636-0fdc-499e-b678-d90b4d72b45b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:04.332480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d583f636-0fdc-499e-b678-d90b4d72b45b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:04.333041 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d583f636-0fdc-499e-b678-d90b4d72b45b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:04.333518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d583f636-0fdc-499e-b678-d90b4d72b45b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:04.395103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d583f636-0fdc-499e-b678-d90b4d72b45b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:04.402513 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d583f636-0fdc-499e-b678-d90b4d72b45b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082292 Jun 20 06:26:04.403079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 548/1110] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:04 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:05.418612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-714f855e-4f49-4fcf-ad9f-ca559710613e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:05.419227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-714f855e-4f49-4fcf-ad9f-ca559710613e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:05.426780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-714f855e-4f49-4fcf-ad9f-ca559710613e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:05.427227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-714f855e-4f49-4fcf-ad9f-ca559710613e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:05.427981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-714f855e-4f49-4fcf-ad9f-ca559710613e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:05.428415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-714f855e-4f49-4fcf-ad9f-ca559710613e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:05.491850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-714f855e-4f49-4fcf-ad9f-ca559710613e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:05.499281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-714f855e-4f49-4fcf-ad9f-ca559710613e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084550 Jun 20 06:26:05.499837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 563/1111] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:05 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:06.515507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f85ffb32-6fc3-446a-8baf-b5892cc6615f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:06.516141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f85ffb32-6fc3-446a-8baf-b5892cc6615f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:06.523504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f85ffb32-6fc3-446a-8baf-b5892cc6615f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:06.523951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f85ffb32-6fc3-446a-8baf-b5892cc6615f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:06.524703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f85ffb32-6fc3-446a-8baf-b5892cc6615f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:06.525135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f85ffb32-6fc3-446a-8baf-b5892cc6615f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:06.587281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f85ffb32-6fc3-446a-8baf-b5892cc6615f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:06.594640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f85ffb32-6fc3-446a-8baf-b5892cc6615f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082998 Jun 20 06:26:06.595190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 549/1112] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:06 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:07.611180 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea6cb18a-dec4-4ed0-8e77-750cebe509c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:07.611736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ea6cb18a-dec4-4ed0-8e77-750cebe509c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:07.618334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6cb18a-dec4-4ed0-8e77-750cebe509c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:07.618776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6cb18a-dec4-4ed0-8e77-750cebe509c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:07.619524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6cb18a-dec4-4ed0-8e77-750cebe509c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:07.619953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6cb18a-dec4-4ed0-8e77-750cebe509c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:07.680798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ea6cb18a-dec4-4ed0-8e77-750cebe509c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:07.688215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ea6cb18a-dec4-4ed0-8e77-750cebe509c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080967 Jun 20 06:26:07.688773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 564/1113] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:07 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:08.704933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-53b41d37-5d06-4596-94f2-a8c3bdde8b38 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:08.705572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-53b41d37-5d06-4596-94f2-a8c3bdde8b38 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:08.712850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-53b41d37-5d06-4596-94f2-a8c3bdde8b38 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:08.713295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-53b41d37-5d06-4596-94f2-a8c3bdde8b38 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:08.714095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-53b41d37-5d06-4596-94f2-a8c3bdde8b38 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:08.714532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-53b41d37-5d06-4596-94f2-a8c3bdde8b38 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:08.775803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-53b41d37-5d06-4596-94f2-a8c3bdde8b38 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:08.783324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-53b41d37-5d06-4596-94f2-a8c3bdde8b38 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082345 Jun 20 06:26:08.783912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 550/1114] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:08 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:09.801862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1f4687b7-09c7-4e0e-a508-795ca3dbfcad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:09.802476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1f4687b7-09c7-4e0e-a508-795ca3dbfcad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:09.804758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:09.810186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1f4687b7-09c7-4e0e-a508-795ca3dbfcad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:09.810637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1f4687b7-09c7-4e0e-a508-795ca3dbfcad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:09.811428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1f4687b7-09c7-4e0e-a508-795ca3dbfcad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:09.811863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1f4687b7-09c7-4e0e-a508-795ca3dbfcad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:09.875784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1f4687b7-09c7-4e0e-a508-795ca3dbfcad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:09.884707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1f4687b7-09c7-4e0e-a508-795ca3dbfcad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087812 Jun 20 06:26:09.885468 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 565/1115] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:09 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:10.901700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8e34a7d2-5e52-4601-bfaf-a71e906c527b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:10.902315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8e34a7d2-5e52-4601-bfaf-a71e906c527b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:10.905169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:10.911123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e34a7d2-5e52-4601-bfaf-a71e906c527b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:10.911577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e34a7d2-5e52-4601-bfaf-a71e906c527b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:10.912360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e34a7d2-5e52-4601-bfaf-a71e906c527b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:10.912803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e34a7d2-5e52-4601-bfaf-a71e906c527b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:10.983033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8e34a7d2-5e52-4601-bfaf-a71e906c527b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:10.991272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8e34a7d2-5e52-4601-bfaf-a71e906c527b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.093465 Jun 20 06:26:10.991827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 551/1116] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:10 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:12.008950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a891487f-3716-4208-a5c5-6c9b62d7912f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:12.010184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a891487f-3716-4208-a5c5-6c9b62d7912f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:12.016708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a891487f-3716-4208-a5c5-6c9b62d7912f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:12.017503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a891487f-3716-4208-a5c5-6c9b62d7912f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:12.019512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a891487f-3716-4208-a5c5-6c9b62d7912f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:12.019957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a891487f-3716-4208-a5c5-6c9b62d7912f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:12.082054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a891487f-3716-4208-a5c5-6c9b62d7912f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:12.089741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a891487f-3716-4208-a5c5-6c9b62d7912f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085361 Jun 20 06:26:12.090302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 566/1117] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:12 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:13.106161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4b85e213-2fac-4e5a-b710-cfafb5e2164b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:13.106775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4b85e213-2fac-4e5a-b710-cfafb5e2164b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:13.113498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b85e213-2fac-4e5a-b710-cfafb5e2164b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:13.113950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b85e213-2fac-4e5a-b710-cfafb5e2164b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:13.114717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b85e213-2fac-4e5a-b710-cfafb5e2164b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:13.115160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b85e213-2fac-4e5a-b710-cfafb5e2164b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:13.174887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4b85e213-2fac-4e5a-b710-cfafb5e2164b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:13.182296 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4b85e213-2fac-4e5a-b710-cfafb5e2164b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.079982 Jun 20 06:26:13.182859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 552/1118] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:13 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:14.199369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-91463fbd-a960-4f69-bfa2-c249bbfedff0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:14.199985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-91463fbd-a960-4f69-bfa2-c249bbfedff0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:14.207090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-91463fbd-a960-4f69-bfa2-c249bbfedff0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:14.207538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-91463fbd-a960-4f69-bfa2-c249bbfedff0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:14.208298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-91463fbd-a960-4f69-bfa2-c249bbfedff0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:14.208733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-91463fbd-a960-4f69-bfa2-c249bbfedff0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:14.271757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-91463fbd-a960-4f69-bfa2-c249bbfedff0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:14.279152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-91463fbd-a960-4f69-bfa2-c249bbfedff0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083649 Jun 20 06:26:14.279711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 567/1119] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:14 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:15.295664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c344275-1b73-4aae-8a5b-9ff2f60b6a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:15.296267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c344275-1b73-4aae-8a5b-9ff2f60b6a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:15.302332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c344275-1b73-4aae-8a5b-9ff2f60b6a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:15.302776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c344275-1b73-4aae-8a5b-9ff2f60b6a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:15.303528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c344275-1b73-4aae-8a5b-9ff2f60b6a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:15.303958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c344275-1b73-4aae-8a5b-9ff2f60b6a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:15.363982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c344275-1b73-4aae-8a5b-9ff2f60b6a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:15.371529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c344275-1b73-4aae-8a5b-9ff2f60b6a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.079847 Jun 20 06:26:15.372105 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 553/1120] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:15 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:16.389135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-56dec622-af48-4eb1-90e1-787dc30848fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:16.389772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-56dec622-af48-4eb1-90e1-787dc30848fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:16.397179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56dec622-af48-4eb1-90e1-787dc30848fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:16.397606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56dec622-af48-4eb1-90e1-787dc30848fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:16.398379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56dec622-af48-4eb1-90e1-787dc30848fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:16.398814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56dec622-af48-4eb1-90e1-787dc30848fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:16.459709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-56dec622-af48-4eb1-90e1-787dc30848fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:16.467195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-56dec622-af48-4eb1-90e1-787dc30848fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081978 Jun 20 06:26:16.467755 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 568/1121] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:16 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:17.484070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-efd2ba80-5176-4481-b515-079ad1a89fac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:17.484685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-efd2ba80-5176-4481-b515-079ad1a89fac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:17.491382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efd2ba80-5176-4481-b515-079ad1a89fac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:17.491827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efd2ba80-5176-4481-b515-079ad1a89fac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:17.492586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efd2ba80-5176-4481-b515-079ad1a89fac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:17.493016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efd2ba80-5176-4481-b515-079ad1a89fac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:17.496853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:17.554976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-efd2ba80-5176-4481-b515-079ad1a89fac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:17.562342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-efd2ba80-5176-4481-b515-079ad1a89fac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082337 Jun 20 06:26:17.562897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 554/1122] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:17 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:18.579103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0c98766f-9a48-4e18-8753-a49a1a435d43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:18.579636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0c98766f-9a48-4e18-8753-a49a1a435d43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:18.586362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c98766f-9a48-4e18-8753-a49a1a435d43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:18.586805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c98766f-9a48-4e18-8753-a49a1a435d43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:18.587558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c98766f-9a48-4e18-8753-a49a1a435d43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:18.587987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c98766f-9a48-4e18-8753-a49a1a435d43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:18.653722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0c98766f-9a48-4e18-8753-a49a1a435d43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:18.662000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0c98766f-9a48-4e18-8753-a49a1a435d43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087012 Jun 20 06:26:18.662554 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 569/1123] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:18 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:19.678822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fec16572-e8fc-474c-8628-30d2dc455cc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:19.679451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fec16572-e8fc-474c-8628-30d2dc455cc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:19.685968 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fec16572-e8fc-474c-8628-30d2dc455cc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:19.686413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fec16572-e8fc-474c-8628-30d2dc455cc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:19.687165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fec16572-e8fc-474c-8628-30d2dc455cc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:19.687594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fec16572-e8fc-474c-8628-30d2dc455cc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:19.747458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fec16572-e8fc-474c-8628-30d2dc455cc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:19.756147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fec16572-e8fc-474c-8628-30d2dc455cc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081143 Jun 20 06:26:19.756713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 555/1124] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:19 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:20.774105 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-267b393d-52f6-4abf-87da-a721f7f873c4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:20.774727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-267b393d-52f6-4abf-87da-a721f7f873c4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:20.781301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-267b393d-52f6-4abf-87da-a721f7f873c4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:20.781779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-267b393d-52f6-4abf-87da-a721f7f873c4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:20.782572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-267b393d-52f6-4abf-87da-a721f7f873c4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:20.783005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-267b393d-52f6-4abf-87da-a721f7f873c4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:20.844743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-267b393d-52f6-4abf-87da-a721f7f873c4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:20.852863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-267b393d-52f6-4abf-87da-a721f7f873c4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083544 Jun 20 06:26:20.853518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 570/1125] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:20 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:21.871558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cffd2840-12c0-4777-980f-f52551b6bafc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:21.872210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cffd2840-12c0-4777-980f-f52551b6bafc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:21.879325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cffd2840-12c0-4777-980f-f52551b6bafc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:21.879784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cffd2840-12c0-4777-980f-f52551b6bafc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:21.880567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cffd2840-12c0-4777-980f-f52551b6bafc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:21.881000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cffd2840-12c0-4777-980f-f52551b6bafc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:22.114016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cffd2840-12c0-4777-980f-f52551b6bafc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:22.121501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cffd2840-12c0-4777-980f-f52551b6bafc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.253895 Jun 20 06:26:22.122065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 556/1126] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:21 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:23.139290 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e5dcd187-5276-44a0-a67e-e0ae4d16e38c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:23.139915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e5dcd187-5276-44a0-a67e-e0ae4d16e38c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:23.146649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e5dcd187-5276-44a0-a67e-e0ae4d16e38c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:23.147095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e5dcd187-5276-44a0-a67e-e0ae4d16e38c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:23.147841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e5dcd187-5276-44a0-a67e-e0ae4d16e38c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:23.148271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e5dcd187-5276-44a0-a67e-e0ae4d16e38c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:23.150770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:23.209275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e5dcd187-5276-44a0-a67e-e0ae4d16e38c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:23.216793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e5dcd187-5276-44a0-a67e-e0ae4d16e38c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081362 Jun 20 06:26:23.217348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 571/1127] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:23 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:24.233879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1b150db4-0fe4-4589-b237-0fdd35635924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:24.234481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1b150db4-0fe4-4589-b237-0fdd35635924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:24.241187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b150db4-0fe4-4589-b237-0fdd35635924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:24.241676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b150db4-0fe4-4589-b237-0fdd35635924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:24.242414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b150db4-0fe4-4589-b237-0fdd35635924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:24.242845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b150db4-0fe4-4589-b237-0fdd35635924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:24.304187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b150db4-0fe4-4589-b237-0fdd35635924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:24.311605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1b150db4-0fe4-4589-b237-0fdd35635924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081601 Jun 20 06:26:24.312175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 557/1128] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:24 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:25.328018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a3b0e456-f296-4b5c-8c0d-fffd674dfb1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:25.328639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a3b0e456-f296-4b5c-8c0d-fffd674dfb1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:25.335234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3b0e456-f296-4b5c-8c0d-fffd674dfb1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:25.335686 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3b0e456-f296-4b5c-8c0d-fffd674dfb1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:25.336462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3b0e456-f296-4b5c-8c0d-fffd674dfb1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:25.336902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3b0e456-f296-4b5c-8c0d-fffd674dfb1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:25.400419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a3b0e456-f296-4b5c-8c0d-fffd674dfb1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:25.407958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a3b0e456-f296-4b5c-8c0d-fffd674dfb1f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083849 Jun 20 06:26:25.408513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 572/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:25 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:26.424947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7975cf23-d238-4690-a885-28dd4f8594fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:26.426246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7975cf23-d238-4690-a885-28dd4f8594fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:26.433136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7975cf23-d238-4690-a885-28dd4f8594fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:26.433625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7975cf23-d238-4690-a885-28dd4f8594fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:26.434392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7975cf23-d238-4690-a885-28dd4f8594fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:26.434827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7975cf23-d238-4690-a885-28dd4f8594fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:26.495816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7975cf23-d238-4690-a885-28dd4f8594fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:26.503221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7975cf23-d238-4690-a885-28dd4f8594fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082101 Jun 20 06:26:26.504921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 558/1130] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:26 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:27.521882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-54e95b37-9e19-4932-9214-d367ecfd3196 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:27.522526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-54e95b37-9e19-4932-9214-d367ecfd3196 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:27.528917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54e95b37-9e19-4932-9214-d367ecfd3196 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:27.529365 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54e95b37-9e19-4932-9214-d367ecfd3196 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:27.530157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54e95b37-9e19-4932-9214-d367ecfd3196 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:27.530592 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54e95b37-9e19-4932-9214-d367ecfd3196 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:27.590752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-54e95b37-9e19-4932-9214-d367ecfd3196 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:27.599006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-54e95b37-9e19-4932-9214-d367ecfd3196 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081838 Jun 20 06:26:27.599565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 573/1131] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:27 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:28.616728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-116adc2c-d697-442c-a2a7-46b07af3794f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:28.617342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-116adc2c-d697-442c-a2a7-46b07af3794f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:28.624450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-116adc2c-d697-442c-a2a7-46b07af3794f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:28.624953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-116adc2c-d697-442c-a2a7-46b07af3794f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:28.625747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-116adc2c-d697-442c-a2a7-46b07af3794f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:28.626187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-116adc2c-d697-442c-a2a7-46b07af3794f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:28.687527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-116adc2c-d697-442c-a2a7-46b07af3794f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:28.695703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-116adc2c-d697-442c-a2a7-46b07af3794f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083476 Jun 20 06:26:28.696270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 559/1132] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:28 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:29.712907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e95ee06e-ebd9-4fed-ba6c-3b8724e8377e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:29.713549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e95ee06e-ebd9-4fed-ba6c-3b8724e8377e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:29.720075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e95ee06e-ebd9-4fed-ba6c-3b8724e8377e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:29.720519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e95ee06e-ebd9-4fed-ba6c-3b8724e8377e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:29.721269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e95ee06e-ebd9-4fed-ba6c-3b8724e8377e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:29.721732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e95ee06e-ebd9-4fed-ba6c-3b8724e8377e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:29.786826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e95ee06e-ebd9-4fed-ba6c-3b8724e8377e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:29.794304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e95ee06e-ebd9-4fed-ba6c-3b8724e8377e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085302 Jun 20 06:26:29.794866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 574/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:29 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:30.811682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-503ad330-848f-483d-ace8-3cf92f7fee7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:30.812298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-503ad330-848f-483d-ace8-3cf92f7fee7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:30.819199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-503ad330-848f-483d-ace8-3cf92f7fee7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:30.819651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-503ad330-848f-483d-ace8-3cf92f7fee7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:30.820929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-503ad330-848f-483d-ace8-3cf92f7fee7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:30.820929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-503ad330-848f-483d-ace8-3cf92f7fee7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:30.883439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-503ad330-848f-483d-ace8-3cf92f7fee7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:30.890976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-503ad330-848f-483d-ace8-3cf92f7fee7b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083364 Jun 20 06:26:30.891530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 560/1134] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:30 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:31.909244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d88a8761-4c3e-4abd-8ae9-b4f6eeb9387e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:31.910306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d88a8761-4c3e-4abd-8ae9-b4f6eeb9387e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:31.917207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d88a8761-4c3e-4abd-8ae9-b4f6eeb9387e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:31.917694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d88a8761-4c3e-4abd-8ae9-b4f6eeb9387e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:31.918458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d88a8761-4c3e-4abd-8ae9-b4f6eeb9387e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:31.918995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d88a8761-4c3e-4abd-8ae9-b4f6eeb9387e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:31.979707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d88a8761-4c3e-4abd-8ae9-b4f6eeb9387e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:31.987089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d88a8761-4c3e-4abd-8ae9-b4f6eeb9387e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082023 Jun 20 06:26:31.987765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 575/1135] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:31 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:33.004062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b9fb6c6f-37e9-4a28-92c9-f3f4de2041b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:33.005298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b9fb6c6f-37e9-4a28-92c9-f3f4de2041b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:33.011923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9fb6c6f-37e9-4a28-92c9-f3f4de2041b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:33.012368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9fb6c6f-37e9-4a28-92c9-f3f4de2041b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:33.013155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9fb6c6f-37e9-4a28-92c9-f3f4de2041b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:33.013623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9fb6c6f-37e9-4a28-92c9-f3f4de2041b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:33.135337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b9fb6c6f-37e9-4a28-92c9-f3f4de2041b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:33.142974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b9fb6c6f-37e9-4a28-92c9-f3f4de2041b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.142805 Jun 20 06:26:33.143531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 561/1136] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:32 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:34.159561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5f44c07d-8b7c-4ffa-b10f-df3d25ca015c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:34.160162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5f44c07d-8b7c-4ffa-b10f-df3d25ca015c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:34.166292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5f44c07d-8b7c-4ffa-b10f-df3d25ca015c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:34.166736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5f44c07d-8b7c-4ffa-b10f-df3d25ca015c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:34.167508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5f44c07d-8b7c-4ffa-b10f-df3d25ca015c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:34.167936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5f44c07d-8b7c-4ffa-b10f-df3d25ca015c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:34.234067 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5f44c07d-8b7c-4ffa-b10f-df3d25ca015c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:34.241406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5f44c07d-8b7c-4ffa-b10f-df3d25ca015c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085665 Jun 20 06:26:34.241965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 576/1137] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:34 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:35.257957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f823c29b-5198-4792-aef1-08618aba40e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:35.258732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f823c29b-5198-4792-aef1-08618aba40e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:35.265249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f823c29b-5198-4792-aef1-08618aba40e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:35.265661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f823c29b-5198-4792-aef1-08618aba40e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:35.266418 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f823c29b-5198-4792-aef1-08618aba40e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:35.266849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f823c29b-5198-4792-aef1-08618aba40e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:35.327245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f823c29b-5198-4792-aef1-08618aba40e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:35.335357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f823c29b-5198-4792-aef1-08618aba40e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081381 Jun 20 06:26:35.335924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 562/1138] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:35 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:36.352405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e60e7448-94b8-4360-acbc-44abe4544b13 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:36.353006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e60e7448-94b8-4360-acbc-44abe4544b13 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:36.359460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e60e7448-94b8-4360-acbc-44abe4544b13 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:36.359898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e60e7448-94b8-4360-acbc-44abe4544b13 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:36.360648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e60e7448-94b8-4360-acbc-44abe4544b13 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:36.361080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e60e7448-94b8-4360-acbc-44abe4544b13 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:36.471809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e60e7448-94b8-4360-acbc-44abe4544b13 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:36.480100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e60e7448-94b8-4360-acbc-44abe4544b13 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.132095 Jun 20 06:26:36.480649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 577/1139] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:36 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:37.496887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b8ac374d-cf4b-40b3-a8ba-2f438e9a05d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:37.497549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b8ac374d-cf4b-40b3-a8ba-2f438e9a05d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:37.504036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8ac374d-cf4b-40b3-a8ba-2f438e9a05d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:37.505146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8ac374d-cf4b-40b3-a8ba-2f438e9a05d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:37.505950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8ac374d-cf4b-40b3-a8ba-2f438e9a05d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:37.506386 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8ac374d-cf4b-40b3-a8ba-2f438e9a05d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:37.567987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b8ac374d-cf4b-40b3-a8ba-2f438e9a05d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:37.575417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b8ac374d-cf4b-40b3-a8ba-2f438e9a05d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082365 Jun 20 06:26:37.575976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 563/1140] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:37 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:38.302584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:26:38.303102 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:26:38.592107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-346a94f3-dca1-4eca-aeec-e5d705d8a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:38.592667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-346a94f3-dca1-4eca-aeec-e5d705d8a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:38.600024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-346a94f3-dca1-4eca-aeec-e5d705d8a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:38.600467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-346a94f3-dca1-4eca-aeec-e5d705d8a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:38.601232 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-346a94f3-dca1-4eca-aeec-e5d705d8a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:38.601687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-346a94f3-dca1-4eca-aeec-e5d705d8a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:38.666801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-346a94f3-dca1-4eca-aeec-e5d705d8a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:38.674230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-346a94f3-dca1-4eca-aeec-e5d705d8a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086122 Jun 20 06:26:38.674776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 578/1141] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:38 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:39.691295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4635097a-24a2-4f66-8993-96cce0c4665e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:39.692528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4635097a-24a2-4f66-8993-96cce0c4665e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:39.698945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4635097a-24a2-4f66-8993-96cce0c4665e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:39.699399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4635097a-24a2-4f66-8993-96cce0c4665e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:39.700161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4635097a-24a2-4f66-8993-96cce0c4665e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:39.700597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4635097a-24a2-4f66-8993-96cce0c4665e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:39.760705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4635097a-24a2-4f66-8993-96cce0c4665e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:39.768376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4635097a-24a2-4f66-8993-96cce0c4665e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080963 Jun 20 06:26:39.768934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 564/1142] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:39 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:40.495761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:26:40.495934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:26:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:26:40.784081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-653b0f48-7fc3-49ec-a36a-f4af5cada120 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:40.784686 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-653b0f48-7fc3-49ec-a36a-f4af5cada120 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:40.787275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:40.792485 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-653b0f48-7fc3-49ec-a36a-f4af5cada120 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:40.792926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-653b0f48-7fc3-49ec-a36a-f4af5cada120 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:40.793705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-653b0f48-7fc3-49ec-a36a-f4af5cada120 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:40.794162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-653b0f48-7fc3-49ec-a36a-f4af5cada120 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:40.854851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-653b0f48-7fc3-49ec-a36a-f4af5cada120 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:40.862409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-653b0f48-7fc3-49ec-a36a-f4af5cada120 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082323 Jun 20 06:26:40.862956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 579/1143] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:40 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:41.880872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f7e59bf-aa0e-41f4-91ba-9d6088283f95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:41.881504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f7e59bf-aa0e-41f4-91ba-9d6088283f95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:41.883862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:41.889726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f7e59bf-aa0e-41f4-91ba-9d6088283f95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:41.890180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f7e59bf-aa0e-41f4-91ba-9d6088283f95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:41.890949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f7e59bf-aa0e-41f4-91ba-9d6088283f95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:41.891413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f7e59bf-aa0e-41f4-91ba-9d6088283f95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:41.953145 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f7e59bf-aa0e-41f4-91ba-9d6088283f95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:41.961369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f7e59bf-aa0e-41f4-91ba-9d6088283f95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085140 Jun 20 06:26:41.961951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 565/1144] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:41 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:42.978109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-27057e62-14fb-4328-a5ce-37f4653726c3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:42.978722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-27057e62-14fb-4328-a5ce-37f4653726c3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:42.985253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27057e62-14fb-4328-a5ce-37f4653726c3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:42.985738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27057e62-14fb-4328-a5ce-37f4653726c3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:42.986498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27057e62-14fb-4328-a5ce-37f4653726c3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:42.986932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27057e62-14fb-4328-a5ce-37f4653726c3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:43.050826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-27057e62-14fb-4328-a5ce-37f4653726c3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:43.059017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-27057e62-14fb-4328-a5ce-37f4653726c3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084825 Jun 20 06:26:43.059572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 580/1145] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:42 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:43.727622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-81d6b137-4723-4da7-ba10-e5792f9f4a23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:26:43.728216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-81d6b137-4723-4da7-ba10-e5792f9f4a23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:43.734699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d6b137-4723-4da7-ba10-e5792f9f4a23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:43.735144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d6b137-4723-4da7-ba10-e5792f9f4a23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:43.735899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d6b137-4723-4da7-ba10-e5792f9f4a23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:43.736330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d6b137-4723-4da7-ba10-e5792f9f4a23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:43.758407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-81d6b137-4723-4da7-ba10-e5792f9f4a23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lazy-loading 'flavor' on Instance uuid df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:26:43.865347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-81d6b137-4723-4da7-ba10-e5792f9f4a23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "POST /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19/action" status: 202 len: 0 microversion: 2.1 time: 0.141984 Jun 20 06:26:43.865958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 566/1146] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jun 20 06:26:43 2022] POST /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:26:43.874970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-238feab8-bf07-4a98-b63f-58da66304a92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:43.875581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-238feab8-bf07-4a98-b63f-58da66304a92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:43.882161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-238feab8-bf07-4a98-b63f-58da66304a92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:43.882576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-238feab8-bf07-4a98-b63f-58da66304a92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:43.883341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-238feab8-bf07-4a98-b63f-58da66304a92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:43.883780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-238feab8-bf07-4a98-b63f-58da66304a92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:44.015502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-238feab8-bf07-4a98-b63f-58da66304a92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:44.026963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-238feab8-bf07-4a98-b63f-58da66304a92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.155744 Jun 20 06:26:44.029167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 581/1147] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:44.076588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-13ad1df1-a537-4b21-8c41-e2c59f9d8ab4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:44.077327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-13ad1df1-a537-4b21-8c41-e2c59f9d8ab4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:44.084376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13ad1df1-a537-4b21-8c41-e2c59f9d8ab4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:44.084827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13ad1df1-a537-4b21-8c41-e2c59f9d8ab4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:44.085623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13ad1df1-a537-4b21-8c41-e2c59f9d8ab4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:44.086095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13ad1df1-a537-4b21-8c41-e2c59f9d8ab4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:44.147878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-13ad1df1-a537-4b21-8c41-e2c59f9d8ab4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:44.155269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-13ad1df1-a537-4b21-8c41-e2c59f9d8ab4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083054 Jun 20 06:26:44.155828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 567/1148] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:44 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:45.047443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a755509-262a-41b7-bf49-b01387366e90 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:45.047991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8a755509-262a-41b7-bf49-b01387366e90 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:45.055239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a755509-262a-41b7-bf49-b01387366e90 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:45.055691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a755509-262a-41b7-bf49-b01387366e90 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:45.056454 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a755509-262a-41b7-bf49-b01387366e90 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:45.056893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a755509-262a-41b7-bf49-b01387366e90 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:45.172171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f93c1d5-bc30-410e-85e4-151004cb66c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:45.172783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f93c1d5-bc30-410e-85e4-151004cb66c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:45.179753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f93c1d5-bc30-410e-85e4-151004cb66c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:45.180201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f93c1d5-bc30-410e-85e4-151004cb66c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:45.180964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f93c1d5-bc30-410e-85e4-151004cb66c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:45.181417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f93c1d5-bc30-410e-85e4-151004cb66c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:45.189789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a755509-262a-41b7-bf49-b01387366e90 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:45.197853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a755509-262a-41b7-bf49-b01387366e90 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154297 Jun 20 06:26:45.198416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 582/1149] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:45.242097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f93c1d5-bc30-410e-85e4-151004cb66c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:45.244355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:45.250834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f93c1d5-bc30-410e-85e4-151004cb66c9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082484 Jun 20 06:26:45.251387 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 568/1150] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:45 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:26:46.215413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dafb6d6f-54d8-4a4c-aded-6e4566c944be tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:46.216006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dafb6d6f-54d8-4a4c-aded-6e4566c944be tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:46.222440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dafb6d6f-54d8-4a4c-aded-6e4566c944be tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:46.222889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dafb6d6f-54d8-4a4c-aded-6e4566c944be tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:46.223717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dafb6d6f-54d8-4a4c-aded-6e4566c944be tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:46.224149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dafb6d6f-54d8-4a4c-aded-6e4566c944be tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:46.268916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bc187f32-fa42-4e18-ab21-9d345ff6ce75 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:46.269589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bc187f32-fa42-4e18-ab21-9d345ff6ce75 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:46.277398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc187f32-fa42-4e18-ab21-9d345ff6ce75 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:46.277953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc187f32-fa42-4e18-ab21-9d345ff6ce75 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:46.278721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc187f32-fa42-4e18-ab21-9d345ff6ce75 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:46.279172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc187f32-fa42-4e18-ab21-9d345ff6ce75 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:46.356229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bc187f32-fa42-4e18-ab21-9d345ff6ce75 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:46.363650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bc187f32-fa42-4e18-ab21-9d345ff6ce75 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.099613 Jun 20 06:26:46.364329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 569/1151] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:46 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:26:46.384497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dafb6d6f-54d8-4a4c-aded-6e4566c944be tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:46.392289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dafb6d6f-54d8-4a4c-aded-6e4566c944be tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.180484 Jun 20 06:26:46.392841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 583/1152] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:47.380419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c625eec-faa0-4dc4-9b50-b1d46d10a79a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:47.381025 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c625eec-faa0-4dc4-9b50-b1d46d10a79a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:47.387432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c625eec-faa0-4dc4-9b50-b1d46d10a79a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:47.387878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c625eec-faa0-4dc4-9b50-b1d46d10a79a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:47.388630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c625eec-faa0-4dc4-9b50-b1d46d10a79a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:47.389066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c625eec-faa0-4dc4-9b50-b1d46d10a79a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:47.409877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c8b43421-2b7d-4800-8750-50164b87ee92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:47.411216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c8b43421-2b7d-4800-8750-50164b87ee92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:47.417571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8b43421-2b7d-4800-8750-50164b87ee92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:47.418015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8b43421-2b7d-4800-8750-50164b87ee92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:47.418804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8b43421-2b7d-4800-8750-50164b87ee92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:47.419237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8b43421-2b7d-4800-8750-50164b87ee92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:47.451964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c625eec-faa0-4dc4-9b50-b1d46d10a79a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:47.460700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c625eec-faa0-4dc4-9b50-b1d46d10a79a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084470 Jun 20 06:26:47.461275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 570/1153] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:47 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:47.548706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c8b43421-2b7d-4800-8750-50164b87ee92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:47.556516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c8b43421-2b7d-4800-8750-50164b87ee92 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150443 Jun 20 06:26:47.557080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 584/1154] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:26:48.477923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f3983ef-e4e2-4650-99f2-21f77b9e9b92 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:48.478533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f3983ef-e4e2-4650-99f2-21f77b9e9b92 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:48.484910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f3983ef-e4e2-4650-99f2-21f77b9e9b92 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:48.485351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f3983ef-e4e2-4650-99f2-21f77b9e9b92 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:48.486133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f3983ef-e4e2-4650-99f2-21f77b9e9b92 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:48.486564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f3983ef-e4e2-4650-99f2-21f77b9e9b92 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:48.548058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f3983ef-e4e2-4650-99f2-21f77b9e9b92 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:48.556083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f3983ef-e4e2-4650-99f2-21f77b9e9b92 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082065 Jun 20 06:26:48.556639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 571/1155] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:48 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:48.573492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9c84577f-509c-4111-adb1-b563f3329ba2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:48.574103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9c84577f-509c-4111-adb1-b563f3329ba2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:48.580498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c84577f-509c-4111-adb1-b563f3329ba2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:48.580885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c84577f-509c-4111-adb1-b563f3329ba2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:48.581670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c84577f-509c-4111-adb1-b563f3329ba2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:48.582107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c84577f-509c-4111-adb1-b563f3329ba2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:48.723924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9c84577f-509c-4111-adb1-b563f3329ba2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:48.731346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9c84577f-509c-4111-adb1-b563f3329ba2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.161674 Jun 20 06:26:48.731915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 585/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:49.573151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c7112608-f8e3-4a7d-bf7e-b6a860baa1af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:49.573797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c7112608-f8e3-4a7d-bf7e-b6a860baa1af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:49.580526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7112608-f8e3-4a7d-bf7e-b6a860baa1af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:49.580916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7112608-f8e3-4a7d-bf7e-b6a860baa1af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:49.581707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7112608-f8e3-4a7d-bf7e-b6a860baa1af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:49.582229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7112608-f8e3-4a7d-bf7e-b6a860baa1af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:49.643725 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c7112608-f8e3-4a7d-bf7e-b6a860baa1af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:49.651221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c7112608-f8e3-4a7d-bf7e-b6a860baa1af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081994 Jun 20 06:26:49.651780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 572/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:49 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:49.747852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4bca636d-221c-49d6-bb9e-27c8351bef1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:49.748458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4bca636d-221c-49d6-bb9e-27c8351bef1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:49.756075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4bca636d-221c-49d6-bb9e-27c8351bef1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:49.756608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4bca636d-221c-49d6-bb9e-27c8351bef1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:49.757455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4bca636d-221c-49d6-bb9e-27c8351bef1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:49.757901 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4bca636d-221c-49d6-bb9e-27c8351bef1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:49.890122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4bca636d-221c-49d6-bb9e-27c8351bef1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:49.897826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4bca636d-221c-49d6-bb9e-27c8351bef1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153760 Jun 20 06:26:49.898383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 586/1158] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:50.667861 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6b56eaa4-55e9-4a19-a745-a7ec3e09557c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:50.668476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6b56eaa4-55e9-4a19-a745-a7ec3e09557c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:50.674911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b56eaa4-55e9-4a19-a745-a7ec3e09557c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:50.675359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b56eaa4-55e9-4a19-a745-a7ec3e09557c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:50.676253 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b56eaa4-55e9-4a19-a745-a7ec3e09557c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:50.676690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b56eaa4-55e9-4a19-a745-a7ec3e09557c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:50.736612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6b56eaa4-55e9-4a19-a745-a7ec3e09557c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:50.744264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6b56eaa4-55e9-4a19-a745-a7ec3e09557c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080254 Jun 20 06:26:50.744828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 573/1159] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:50 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:50.914712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dcfa5884-e404-4523-bfd0-b425622386ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:50.915329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dcfa5884-e404-4523-bfd0-b425622386ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:50.921921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dcfa5884-e404-4523-bfd0-b425622386ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:50.922306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dcfa5884-e404-4523-bfd0-b425622386ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:50.923067 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dcfa5884-e404-4523-bfd0-b425622386ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:50.923500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dcfa5884-e404-4523-bfd0-b425622386ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:51.052951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dcfa5884-e404-4523-bfd0-b425622386ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:51.055138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:51.061775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dcfa5884-e404-4523-bfd0-b425622386ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150841 Jun 20 06:26:51.062349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 587/1160] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:51.760707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a503f6e4-87b6-4744-9f2c-82426c4751c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:51.761307 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a503f6e4-87b6-4744-9f2c-82426c4751c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:51.767996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a503f6e4-87b6-4744-9f2c-82426c4751c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:51.768443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a503f6e4-87b6-4744-9f2c-82426c4751c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:51.769195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a503f6e4-87b6-4744-9f2c-82426c4751c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:51.770265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a503f6e4-87b6-4744-9f2c-82426c4751c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:51.831403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a503f6e4-87b6-4744-9f2c-82426c4751c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:51.839667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a503f6e4-87b6-4744-9f2c-82426c4751c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082742 Jun 20 06:26:51.840237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 574/1161] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:51 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:52.079976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f11b6de5-5d3c-4ea1-8b0b-892ec941448c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:52.080521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f11b6de5-5d3c-4ea1-8b0b-892ec941448c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:52.087412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f11b6de5-5d3c-4ea1-8b0b-892ec941448c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:52.087855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f11b6de5-5d3c-4ea1-8b0b-892ec941448c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:52.088607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f11b6de5-5d3c-4ea1-8b0b-892ec941448c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:52.089036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f11b6de5-5d3c-4ea1-8b0b-892ec941448c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:52.221666 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f11b6de5-5d3c-4ea1-8b0b-892ec941448c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:52.229229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f11b6de5-5d3c-4ea1-8b0b-892ec941448c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153202 Jun 20 06:26:52.229826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 588/1162] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:52.856432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-becbe1b3-bdf3-4e54-b790-a6e64c9e3749 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:52.857044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-becbe1b3-bdf3-4e54-b790-a6e64c9e3749 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:52.865008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-becbe1b3-bdf3-4e54-b790-a6e64c9e3749 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:52.865489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-becbe1b3-bdf3-4e54-b790-a6e64c9e3749 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:52.866266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-becbe1b3-bdf3-4e54-b790-a6e64c9e3749 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:52.867319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-becbe1b3-bdf3-4e54-b790-a6e64c9e3749 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:52.931917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-becbe1b3-bdf3-4e54-b790-a6e64c9e3749 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:52.939307 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-becbe1b3-bdf3-4e54-b790-a6e64c9e3749 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087342 Jun 20 06:26:52.939863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 575/1163] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:52 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:53.246243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ef335af6-694c-4b04-aba5-9ae01cdc6c32 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:53.246854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ef335af6-694c-4b04-aba5-9ae01cdc6c32 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:53.253491 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef335af6-694c-4b04-aba5-9ae01cdc6c32 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:53.253967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef335af6-694c-4b04-aba5-9ae01cdc6c32 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:53.254961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef335af6-694c-4b04-aba5-9ae01cdc6c32 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:53.255393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef335af6-694c-4b04-aba5-9ae01cdc6c32 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:53.390933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ef335af6-694c-4b04-aba5-9ae01cdc6c32 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:53.399406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ef335af6-694c-4b04-aba5-9ae01cdc6c32 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156975 Jun 20 06:26:53.399967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 589/1164] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:53 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:53.955821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b7896efe-ceed-4b31-99cf-3e7320f4b498 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:53.956425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b7896efe-ceed-4b31-99cf-3e7320f4b498 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:53.963478 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7896efe-ceed-4b31-99cf-3e7320f4b498 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:53.963927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7896efe-ceed-4b31-99cf-3e7320f4b498 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:53.964676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7896efe-ceed-4b31-99cf-3e7320f4b498 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:53.965107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b7896efe-ceed-4b31-99cf-3e7320f4b498 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:54.026291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b7896efe-ceed-4b31-99cf-3e7320f4b498 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:54.033829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b7896efe-ceed-4b31-99cf-3e7320f4b498 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081764 Jun 20 06:26:54.034396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 576/1165] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:53 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:54.417904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-48702aee-3f46-4f3f-81bd-dd046ca4cfbc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:54.418486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-48702aee-3f46-4f3f-81bd-dd046ca4cfbc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:54.424312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48702aee-3f46-4f3f-81bd-dd046ca4cfbc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:54.424964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48702aee-3f46-4f3f-81bd-dd046ca4cfbc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:54.426930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48702aee-3f46-4f3f-81bd-dd046ca4cfbc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:54.427719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48702aee-3f46-4f3f-81bd-dd046ca4cfbc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:54.629785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-48702aee-3f46-4f3f-81bd-dd046ca4cfbc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:54.637052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-48702aee-3f46-4f3f-81bd-dd046ca4cfbc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.224058 Jun 20 06:26:54.637638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 590/1166] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:55.051530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-58cb1654-18b8-447f-b507-4bb5605deb91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:55.052301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-58cb1654-18b8-447f-b507-4bb5605deb91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:55.058831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58cb1654-18b8-447f-b507-4bb5605deb91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:55.059289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58cb1654-18b8-447f-b507-4bb5605deb91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:55.060066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58cb1654-18b8-447f-b507-4bb5605deb91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:55.060513 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58cb1654-18b8-447f-b507-4bb5605deb91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:55.126126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-58cb1654-18b8-447f-b507-4bb5605deb91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:55.133829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-58cb1654-18b8-447f-b507-4bb5605deb91 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086670 Jun 20 06:26:55.134401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 577/1167] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:55 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:55.655945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-06334c01-65cd-4679-99c1-3774acdeaa9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:55.656556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-06334c01-65cd-4679-99c1-3774acdeaa9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:55.664010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06334c01-65cd-4679-99c1-3774acdeaa9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:55.664461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06334c01-65cd-4679-99c1-3774acdeaa9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:55.665217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06334c01-65cd-4679-99c1-3774acdeaa9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:55.665680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06334c01-65cd-4679-99c1-3774acdeaa9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:55.796202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-06334c01-65cd-4679-99c1-3774acdeaa9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:55.803685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-06334c01-65cd-4679-99c1-3774acdeaa9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151615 Jun 20 06:26:55.804245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 591/1168] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:56.151445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-295d4145-bafe-45ca-8ac9-4b488e7fc6ed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:56.152061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-295d4145-bafe-45ca-8ac9-4b488e7fc6ed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:56.158746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295d4145-bafe-45ca-8ac9-4b488e7fc6ed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:56.159196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295d4145-bafe-45ca-8ac9-4b488e7fc6ed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:56.159976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295d4145-bafe-45ca-8ac9-4b488e7fc6ed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:56.160423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-295d4145-bafe-45ca-8ac9-4b488e7fc6ed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:56.220152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-295d4145-bafe-45ca-8ac9-4b488e7fc6ed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:56.227721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-295d4145-bafe-45ca-8ac9-4b488e7fc6ed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080021 Jun 20 06:26:56.228290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 578/1169] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:56 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:56.821344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-17620a75-d7a0-4130-9071-c0d9cede6758 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:56.821976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-17620a75-d7a0-4130-9071-c0d9cede6758 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:56.828431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17620a75-d7a0-4130-9071-c0d9cede6758 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:56.828874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17620a75-d7a0-4130-9071-c0d9cede6758 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:56.829660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17620a75-d7a0-4130-9071-c0d9cede6758 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:56.830094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17620a75-d7a0-4130-9071-c0d9cede6758 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:56.962376 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-17620a75-d7a0-4130-9071-c0d9cede6758 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:56.970151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-17620a75-d7a0-4130-9071-c0d9cede6758 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152654 Jun 20 06:26:56.970714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 592/1170] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:57.244503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4a083604-52d3-4b56-b93e-5c012fe7c426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:57.245115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4a083604-52d3-4b56-b93e-5c012fe7c426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:57.251568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a083604-52d3-4b56-b93e-5c012fe7c426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:57.252020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a083604-52d3-4b56-b93e-5c012fe7c426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:57.252782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a083604-52d3-4b56-b93e-5c012fe7c426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:57.253227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a083604-52d3-4b56-b93e-5c012fe7c426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:57.314497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4a083604-52d3-4b56-b93e-5c012fe7c426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:57.322561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4a083604-52d3-4b56-b93e-5c012fe7c426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081867 Jun 20 06:26:57.323122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 579/1171] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:57 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:57.987821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-29139f6c-486c-44c5-ae0f-1a0dda0f5517 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:57.989396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-29139f6c-486c-44c5-ae0f-1a0dda0f5517 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:57.995816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29139f6c-486c-44c5-ae0f-1a0dda0f5517 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:57.996265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29139f6c-486c-44c5-ae0f-1a0dda0f5517 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:57.997024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29139f6c-486c-44c5-ae0f-1a0dda0f5517 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:57.997607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29139f6c-486c-44c5-ae0f-1a0dda0f5517 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:58.126484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-29139f6c-486c-44c5-ae0f-1a0dda0f5517 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:58.133815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-29139f6c-486c-44c5-ae0f-1a0dda0f5517 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149868 Jun 20 06:26:58.134370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 593/1172] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:58.339025 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2fd25529-3f01-4301-90b2-6121179cb58a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:58.339634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2fd25529-3f01-4301-90b2-6121179cb58a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:58.346092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fd25529-3f01-4301-90b2-6121179cb58a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:58.346537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fd25529-3f01-4301-90b2-6121179cb58a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:58.347286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fd25529-3f01-4301-90b2-6121179cb58a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:58.348485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fd25529-3f01-4301-90b2-6121179cb58a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:58.411358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2fd25529-3f01-4301-90b2-6121179cb58a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:58.418769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2fd25529-3f01-4301-90b2-6121179cb58a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083577 Jun 20 06:26:58.419334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 580/1173] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:58 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:59.151549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-81efd135-2b4c-457d-bd6b-6a5bcbfd7051 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:59.152172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-81efd135-2b4c-457d-bd6b-6a5bcbfd7051 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:59.158607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-81efd135-2b4c-457d-bd6b-6a5bcbfd7051 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:59.159047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-81efd135-2b4c-457d-bd6b-6a5bcbfd7051 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:59.159824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-81efd135-2b4c-457d-bd6b-6a5bcbfd7051 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:59.160263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-81efd135-2b4c-457d-bd6b-6a5bcbfd7051 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:59.289524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-81efd135-2b4c-457d-bd6b-6a5bcbfd7051 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:59.296893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-81efd135-2b4c-457d-bd6b-6a5bcbfd7051 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149218 Jun 20 06:26:59.297474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 594/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:59.435962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-204f50fd-a1ba-479a-a597-ff66d91e1d99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:59.436530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-204f50fd-a1ba-479a-a597-ff66d91e1d99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:59.442930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-204f50fd-a1ba-479a-a597-ff66d91e1d99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:59.443374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-204f50fd-a1ba-479a-a597-ff66d91e1d99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:59.444194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-204f50fd-a1ba-479a-a597-ff66d91e1d99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:59.444562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-204f50fd-a1ba-479a-a597-ff66d91e1d99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:59.504852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-204f50fd-a1ba-479a-a597-ff66d91e1d99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:59.512192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-204f50fd-a1ba-479a-a597-ff66d91e1d99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080162 Jun 20 06:26:59.512748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 581/1175] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:59 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:00.314460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-55a83973-b095-4749-934d-58c19fdf8344 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:00.315708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-55a83973-b095-4749-934d-58c19fdf8344 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:00.322715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-55a83973-b095-4749-934d-58c19fdf8344 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:00.323161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-55a83973-b095-4749-934d-58c19fdf8344 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:00.323930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-55a83973-b095-4749-934d-58c19fdf8344 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:00.324367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-55a83973-b095-4749-934d-58c19fdf8344 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:00.351898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-417a6742-c80e-47a7-a080-eecdb27f8c79 req-759636f2-87f2-4096-941e-8764ac120f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0ade09-352b-4eb4-8c02-2bc3e8ed1c19", "name": "network-vif-unplugged", "status": "completed", "tag": "c0a4dc40-28c7-4749-ab81-fe55f9a8c0da"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:27:00.360565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-417a6742-c80e-47a7-a080-eecdb27f8c79 req-759636f2-87f2-4096-941e-8764ac120f56 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:00.360997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-417a6742-c80e-47a7-a080-eecdb27f8c79 req-759636f2-87f2-4096-941e-8764ac120f56 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:00.377067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-417a6742-c80e-47a7-a080-eecdb27f8c79 req-759636f2-87f2-4096-941e-8764ac120f56 service nova] Creating event network-vif-unplugged:c0a4dc40-28c7-4749-ab81-fe55f9a8c0da for instance df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 on hv-cinder-80473 Jun 20 06:27:00.382514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-417a6742-c80e-47a7-a080-eecdb27f8c79 req-759636f2-87f2-4096-941e-8764ac120f56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035158 Jun 20 06:27:00.383310 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 582/1176] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:27:00.462059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-55a83973-b095-4749-934d-58c19fdf8344 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:00.470712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-55a83973-b095-4749-934d-58c19fdf8344 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.160062 Jun 20 06:27:00.471282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 595/1177] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:00.530836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-541204a0-a152-41b6-9f1d-7bc4a9c9b1a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:00.531469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-541204a0-a152-41b6-9f1d-7bc4a9c9b1a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:00.538738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-541204a0-a152-41b6-9f1d-7bc4a9c9b1a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:00.539199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-541204a0-a152-41b6-9f1d-7bc4a9c9b1a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:00.540129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-541204a0-a152-41b6-9f1d-7bc4a9c9b1a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:00.540614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-541204a0-a152-41b6-9f1d-7bc4a9c9b1a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:00.601652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-541204a0-a152-41b6-9f1d-7bc4a9c9b1a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:00.609422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-541204a0-a152-41b6-9f1d-7bc4a9c9b1a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082859 Jun 20 06:27:00.610004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 583/1178] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:00 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:01.488415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fa7fe395-77ed-4553-aaca-59a2accfe476 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:01.489017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fa7fe395-77ed-4553-aaca-59a2accfe476 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:01.495567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa7fe395-77ed-4553-aaca-59a2accfe476 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:01.496007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa7fe395-77ed-4553-aaca-59a2accfe476 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:01.496757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa7fe395-77ed-4553-aaca-59a2accfe476 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:01.497188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa7fe395-77ed-4553-aaca-59a2accfe476 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:01.625371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fa7fe395-77ed-4553-aaca-59a2accfe476 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:01.626988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1da1f4c5-4716-4a4a-a7f1-e16ae1054e19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:01.627670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1da1f4c5-4716-4a4a-a7f1-e16ae1054e19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:01.633392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fa7fe395-77ed-4553-aaca-59a2accfe476 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148849 Jun 20 06:27:01.634162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 596/1179] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:01.635198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1da1f4c5-4716-4a4a-a7f1-e16ae1054e19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:01.635649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1da1f4c5-4716-4a4a-a7f1-e16ae1054e19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:01.636423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1da1f4c5-4716-4a4a-a7f1-e16ae1054e19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:01.636872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1da1f4c5-4716-4a4a-a7f1-e16ae1054e19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:01.701297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1da1f4c5-4716-4a4a-a7f1-e16ae1054e19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:01.709566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1da1f4c5-4716-4a4a-a7f1-e16ae1054e19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086779 Jun 20 06:27:01.710134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 584/1180] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:01 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:02.651238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fcf6a630-6f77-4281-b29d-e65106ab64e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:02.651856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fcf6a630-6f77-4281-b29d-e65106ab64e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:02.658871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcf6a630-6f77-4281-b29d-e65106ab64e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.659312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcf6a630-6f77-4281-b29d-e65106ab64e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.660267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcf6a630-6f77-4281-b29d-e65106ab64e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.660947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fcf6a630-6f77-4281-b29d-e65106ab64e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.726131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3de19b71-57a2-4fb7-9d4f-b0af3ccae1bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:02.726770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3de19b71-57a2-4fb7-9d4f-b0af3ccae1bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:02.733161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3de19b71-57a2-4fb7-9d4f-b0af3ccae1bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.733635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3de19b71-57a2-4fb7-9d4f-b0af3ccae1bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.734394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3de19b71-57a2-4fb7-9d4f-b0af3ccae1bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.734824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3de19b71-57a2-4fb7-9d4f-b0af3ccae1bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.812359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3de19b71-57a2-4fb7-9d4f-b0af3ccae1bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:02.817023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fcf6a630-6f77-4281-b29d-e65106ab64e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:02.820604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3de19b71-57a2-4fb7-9d4f-b0af3ccae1bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.098320 Jun 20 06:27:02.821184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 585/1181] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:02 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:02.824460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fcf6a630-6f77-4281-b29d-e65106ab64e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.177060 Jun 20 06:27:02.825018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 597/1182] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:03.837539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f8a4739b-757f-4b60-b407-d8b5446f0c23 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:03.838151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f8a4739b-757f-4b60-b407-d8b5446f0c23 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:03.841485 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-48462ff9-d109-4f27-8116-84c48ed786a5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:03.842095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-48462ff9-d109-4f27-8116-84c48ed786a5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:03.844707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8a4739b-757f-4b60-b407-d8b5446f0c23 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:03.845183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8a4739b-757f-4b60-b407-d8b5446f0c23 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:03.845978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8a4739b-757f-4b60-b407-d8b5446f0c23 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:03.846449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8a4739b-757f-4b60-b407-d8b5446f0c23 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:03.848510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48462ff9-d109-4f27-8116-84c48ed786a5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:03.848950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48462ff9-d109-4f27-8116-84c48ed786a5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:03.849730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48462ff9-d109-4f27-8116-84c48ed786a5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:03.850155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48462ff9-d109-4f27-8116-84c48ed786a5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:03.851006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:03.915289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f8a4739b-757f-4b60-b407-d8b5446f0c23 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:03.922787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f8a4739b-757f-4b60-b407-d8b5446f0c23 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.089174 Jun 20 06:27:03.923357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 586/1183] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:03 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:04.001995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-48462ff9-d109-4f27-8116-84c48ed786a5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:04.009494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-48462ff9-d109-4f27-8116-84c48ed786a5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.171970 Jun 20 06:27:04.010058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 598/1184] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:04.940337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ccf5a6c4-4119-4156-aad7-4d96867ecdc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:04.941857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ccf5a6c4-4119-4156-aad7-4d96867ecdc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:04.948425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccf5a6c4-4119-4156-aad7-4d96867ecdc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:04.948875 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccf5a6c4-4119-4156-aad7-4d96867ecdc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:04.949666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccf5a6c4-4119-4156-aad7-4d96867ecdc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:04.950104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ccf5a6c4-4119-4156-aad7-4d96867ecdc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:05.011425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ccf5a6c4-4119-4156-aad7-4d96867ecdc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:05.019032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ccf5a6c4-4119-4156-aad7-4d96867ecdc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082525 Jun 20 06:27:05.019630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 587/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:04 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:05.026983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9aa2cc68-903f-48c2-ae15-d7c54efa927f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:05.027597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9aa2cc68-903f-48c2-ae15-d7c54efa927f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:05.034082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9aa2cc68-903f-48c2-ae15-d7c54efa927f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:05.034526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9aa2cc68-903f-48c2-ae15-d7c54efa927f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:05.035372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9aa2cc68-903f-48c2-ae15-d7c54efa927f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:05.035719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9aa2cc68-903f-48c2-ae15-d7c54efa927f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:05.167285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9aa2cc68-903f-48c2-ae15-d7c54efa927f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:05.174723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9aa2cc68-903f-48c2-ae15-d7c54efa927f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151555 Jun 20 06:27:05.175788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 599/1186] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:06.036839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0dd0ce21-a6cc-4aad-8763-73cd4d500fd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:06.037525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0dd0ce21-a6cc-4aad-8763-73cd4d500fd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:06.044030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dd0ce21-a6cc-4aad-8763-73cd4d500fd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:06.044480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dd0ce21-a6cc-4aad-8763-73cd4d500fd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:06.045243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dd0ce21-a6cc-4aad-8763-73cd4d500fd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:06.045717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dd0ce21-a6cc-4aad-8763-73cd4d500fd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:06.110993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0dd0ce21-a6cc-4aad-8763-73cd4d500fd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:06.118980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0dd0ce21-a6cc-4aad-8763-73cd4d500fd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086943 Jun 20 06:27:06.119557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 588/1187] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:06 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:06.192464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a34f731e-2ee4-4d73-88fc-8c7914faac74 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:06.193087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a34f731e-2ee4-4d73-88fc-8c7914faac74 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:06.199614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a34f731e-2ee4-4d73-88fc-8c7914faac74 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:06.200065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a34f731e-2ee4-4d73-88fc-8c7914faac74 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:06.200838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a34f731e-2ee4-4d73-88fc-8c7914faac74 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:06.201307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a34f731e-2ee4-4d73-88fc-8c7914faac74 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:06.329419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a34f731e-2ee4-4d73-88fc-8c7914faac74 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:06.337683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a34f731e-2ee4-4d73-88fc-8c7914faac74 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149661 Jun 20 06:27:06.338244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 600/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:07.135676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0bae3e57-8222-41a5-bb39-a5bcbe6ebfaa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:07.136287 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0bae3e57-8222-41a5-bb39-a5bcbe6ebfaa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:07.143010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bae3e57-8222-41a5-bb39-a5bcbe6ebfaa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:07.143468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bae3e57-8222-41a5-bb39-a5bcbe6ebfaa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:07.144857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bae3e57-8222-41a5-bb39-a5bcbe6ebfaa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:07.145301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bae3e57-8222-41a5-bb39-a5bcbe6ebfaa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:07.204375 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0bae3e57-8222-41a5-bb39-a5bcbe6ebfaa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:07.212314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0bae3e57-8222-41a5-bb39-a5bcbe6ebfaa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080541 Jun 20 06:27:07.212879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 589/1189] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:07 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:07.354455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2ab28c14-ac68-45b1-9108-63cdbedbcdfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:07.355074 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2ab28c14-ac68-45b1-9108-63cdbedbcdfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:07.361588 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ab28c14-ac68-45b1-9108-63cdbedbcdfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:07.362038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ab28c14-ac68-45b1-9108-63cdbedbcdfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:07.362804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ab28c14-ac68-45b1-9108-63cdbedbcdfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:07.363422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ab28c14-ac68-45b1-9108-63cdbedbcdfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:07.493352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2ab28c14-ac68-45b1-9108-63cdbedbcdfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:07.500741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2ab28c14-ac68-45b1-9108-63cdbedbcdfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150170 Jun 20 06:27:07.501303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 601/1190] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:08.228975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a122f212-1ab1-4563-8aa0-51c086506f42 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:08.229609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a122f212-1ab1-4563-8aa0-51c086506f42 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:08.236026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a122f212-1ab1-4563-8aa0-51c086506f42 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:08.236476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a122f212-1ab1-4563-8aa0-51c086506f42 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:08.237237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a122f212-1ab1-4563-8aa0-51c086506f42 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:08.238312 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a122f212-1ab1-4563-8aa0-51c086506f42 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:08.298724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a122f212-1ab1-4563-8aa0-51c086506f42 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:08.306880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a122f212-1ab1-4563-8aa0-51c086506f42 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081779 Jun 20 06:27:08.307450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 590/1191] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:08 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:08.518350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fd76849e-9322-46f4-8567-8a53051eff51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:08.518908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fd76849e-9322-46f4-8567-8a53051eff51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:08.525497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd76849e-9322-46f4-8567-8a53051eff51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:08.525949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd76849e-9322-46f4-8567-8a53051eff51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:08.526713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd76849e-9322-46f4-8567-8a53051eff51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:08.527145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd76849e-9322-46f4-8567-8a53051eff51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:08.655704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fd76849e-9322-46f4-8567-8a53051eff51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:08.664397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fd76849e-9322-46f4-8567-8a53051eff51 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150251 Jun 20 06:27:08.664955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 602/1192] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:09.322851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fc0ec015-bb5b-4d11-a0f7-36ec7a411d7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:09.323457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fc0ec015-bb5b-4d11-a0f7-36ec7a411d7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:09.330185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc0ec015-bb5b-4d11-a0f7-36ec7a411d7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:09.330631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc0ec015-bb5b-4d11-a0f7-36ec7a411d7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:09.331446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc0ec015-bb5b-4d11-a0f7-36ec7a411d7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:09.332400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc0ec015-bb5b-4d11-a0f7-36ec7a411d7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:09.395095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fc0ec015-bb5b-4d11-a0f7-36ec7a411d7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:09.403335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fc0ec015-bb5b-4d11-a0f7-36ec7a411d7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084218 Jun 20 06:27:09.404094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 591/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:09 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:09.681338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-17e9740e-be49-45cf-a829-ae3e45ac01ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:09.681973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-17e9740e-be49-45cf-a829-ae3e45ac01ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:09.688422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17e9740e-be49-45cf-a829-ae3e45ac01ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:09.688838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17e9740e-be49-45cf-a829-ae3e45ac01ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:09.689621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17e9740e-be49-45cf-a829-ae3e45ac01ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:09.690047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17e9740e-be49-45cf-a829-ae3e45ac01ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:09.821511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-17e9740e-be49-45cf-a829-ae3e45ac01ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:09.828967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-17e9740e-be49-45cf-a829-ae3e45ac01ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151457 Jun 20 06:27:09.829553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 603/1194] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:10.419969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fae7de7c-a92b-45d4-9b8f-19e262325024 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:10.420735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fae7de7c-a92b-45d4-9b8f-19e262325024 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:10.427894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fae7de7c-a92b-45d4-9b8f-19e262325024 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:10.428347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fae7de7c-a92b-45d4-9b8f-19e262325024 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:10.429111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fae7de7c-a92b-45d4-9b8f-19e262325024 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:10.429595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fae7de7c-a92b-45d4-9b8f-19e262325024 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:10.492947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fae7de7c-a92b-45d4-9b8f-19e262325024 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:10.500476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fae7de7c-a92b-45d4-9b8f-19e262325024 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084326 Jun 20 06:27:10.501046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 592/1195] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:10 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:10.846099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f1764b1d-e89a-4964-9fd4-bbcb0e64d9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:10.846704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f1764b1d-e89a-4964-9fd4-bbcb0e64d9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:10.849094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=50 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:10.854362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f1764b1d-e89a-4964-9fd4-bbcb0e64d9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:10.854801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f1764b1d-e89a-4964-9fd4-bbcb0e64d9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:10.855557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f1764b1d-e89a-4964-9fd4-bbcb0e64d9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:10.855986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f1764b1d-e89a-4964-9fd4-bbcb0e64d9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:10.870525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:10.987331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f1764b1d-e89a-4964-9fd4-bbcb0e64d9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:10.995360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f1764b1d-e89a-4964-9fd4-bbcb0e64d9fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153113 Jun 20 06:27:10.995950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 604/1196] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:10 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:11.517587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f20048c-f178-449e-b6ee-1ddc11b92a16 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:11.518196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f20048c-f178-449e-b6ee-1ddc11b92a16 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:11.524568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f20048c-f178-449e-b6ee-1ddc11b92a16 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:11.525012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f20048c-f178-449e-b6ee-1ddc11b92a16 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:11.525794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f20048c-f178-449e-b6ee-1ddc11b92a16 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:11.526226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f20048c-f178-449e-b6ee-1ddc11b92a16 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:11.586889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f20048c-f178-449e-b6ee-1ddc11b92a16 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:11.594321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f20048c-f178-449e-b6ee-1ddc11b92a16 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080932 Jun 20 06:27:11.594876 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 593/1197] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:11 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:12.060138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-80e3254b-9c9b-4a66-b281-934051415ede tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:12.060747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-80e3254b-9c9b-4a66-b281-934051415ede tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:12.067295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80e3254b-9c9b-4a66-b281-934051415ede tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:12.067734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80e3254b-9c9b-4a66-b281-934051415ede tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:12.068489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80e3254b-9c9b-4a66-b281-934051415ede tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:12.068916 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80e3254b-9c9b-4a66-b281-934051415ede tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:12.198912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-80e3254b-9c9b-4a66-b281-934051415ede tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:12.206943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-80e3254b-9c9b-4a66-b281-934051415ede tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.197631 Jun 20 06:27:12.207505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 605/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:12.611505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8624647a-2bed-4096-8352-8ea6eeff43cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:12.612052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8624647a-2bed-4096-8352-8ea6eeff43cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:12.614862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=58 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:12.620049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8624647a-2bed-4096-8352-8ea6eeff43cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:12.620506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8624647a-2bed-4096-8352-8ea6eeff43cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:12.621277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8624647a-2bed-4096-8352-8ea6eeff43cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:12.621748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8624647a-2bed-4096-8352-8ea6eeff43cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:12.685141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8624647a-2bed-4096-8352-8ea6eeff43cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:12.693499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8624647a-2bed-4096-8352-8ea6eeff43cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085900 Jun 20 06:27:12.694076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 594/1199] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:12 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:13.224469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-03e5e5db-3681-4155-8ae8-7b2bb9518ef1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:13.225080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-03e5e5db-3681-4155-8ae8-7b2bb9518ef1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:13.231532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03e5e5db-3681-4155-8ae8-7b2bb9518ef1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:13.231979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03e5e5db-3681-4155-8ae8-7b2bb9518ef1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:13.232739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03e5e5db-3681-4155-8ae8-7b2bb9518ef1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:13.233177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03e5e5db-3681-4155-8ae8-7b2bb9518ef1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:13.360605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-03e5e5db-3681-4155-8ae8-7b2bb9518ef1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:13.368623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-03e5e5db-3681-4155-8ae8-7b2bb9518ef1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148636 Jun 20 06:27:13.369190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 606/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:13.710846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-43cf3b23-a06e-4397-8898-14f9c0c07fc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:13.711458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-43cf3b23-a06e-4397-8898-14f9c0c07fc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:13.717925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43cf3b23-a06e-4397-8898-14f9c0c07fc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:13.718373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43cf3b23-a06e-4397-8898-14f9c0c07fc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:13.719130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43cf3b23-a06e-4397-8898-14f9c0c07fc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:13.719566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43cf3b23-a06e-4397-8898-14f9c0c07fc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:13.787088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43cf3b23-a06e-4397-8898-14f9c0c07fc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:13.794662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-43cf3b23-a06e-4397-8898-14f9c0c07fc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.088418 Jun 20 06:27:13.795234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 595/1201] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:13 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:14.385733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4dd6d27f-384e-497f-a4b9-bffe56870290 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:14.386400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4dd6d27f-384e-497f-a4b9-bffe56870290 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:14.393144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4dd6d27f-384e-497f-a4b9-bffe56870290 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:14.393632 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4dd6d27f-384e-497f-a4b9-bffe56870290 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:14.394893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4dd6d27f-384e-497f-a4b9-bffe56870290 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:14.395341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4dd6d27f-384e-497f-a4b9-bffe56870290 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:14.525236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4dd6d27f-384e-497f-a4b9-bffe56870290 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:14.532587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4dd6d27f-384e-497f-a4b9-bffe56870290 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150779 Jun 20 06:27:14.533139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 607/1202] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:14.811226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c542a153-8754-4dfe-8438-e7e051e714f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:14.811883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c542a153-8754-4dfe-8438-e7e051e714f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:14.818339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c542a153-8754-4dfe-8438-e7e051e714f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:14.818804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c542a153-8754-4dfe-8438-e7e051e714f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:14.819537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c542a153-8754-4dfe-8438-e7e051e714f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:14.819968 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c542a153-8754-4dfe-8438-e7e051e714f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:14.879940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c542a153-8754-4dfe-8438-e7e051e714f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:14.887302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c542a153-8754-4dfe-8438-e7e051e714f8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080229 Jun 20 06:27:14.887857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 596/1203] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:14 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:15.550579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-52d52077-b401-4f5e-a7d5-070da0faa291 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:15.551202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-52d52077-b401-4f5e-a7d5-070da0faa291 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:15.557667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52d52077-b401-4f5e-a7d5-070da0faa291 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:15.558119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52d52077-b401-4f5e-a7d5-070da0faa291 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:15.558863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52d52077-b401-4f5e-a7d5-070da0faa291 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:15.559298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52d52077-b401-4f5e-a7d5-070da0faa291 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:15.687167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-52d52077-b401-4f5e-a7d5-070da0faa291 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:15.694631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-52d52077-b401-4f5e-a7d5-070da0faa291 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148386 Jun 20 06:27:15.695395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 608/1204] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:15 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:15.904010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f01182ce-f35b-41e0-aa23-fdd4e8b2645c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:15.904552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f01182ce-f35b-41e0-aa23-fdd4e8b2645c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:15.911418 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f01182ce-f35b-41e0-aa23-fdd4e8b2645c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:15.911865 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f01182ce-f35b-41e0-aa23-fdd4e8b2645c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:15.912651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f01182ce-f35b-41e0-aa23-fdd4e8b2645c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:15.913090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f01182ce-f35b-41e0-aa23-fdd4e8b2645c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:15.975350 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f01182ce-f35b-41e0-aa23-fdd4e8b2645c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:15.982786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f01182ce-f35b-41e0-aa23-fdd4e8b2645c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082673 Jun 20 06:27:15.983342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 597/1205] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:15 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:16.711649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-be4c5416-254c-4bce-a5fd-4785009ab67a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:16.712255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-be4c5416-254c-4bce-a5fd-4785009ab67a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:16.718729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be4c5416-254c-4bce-a5fd-4785009ab67a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:16.719171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be4c5416-254c-4bce-a5fd-4785009ab67a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:16.719918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be4c5416-254c-4bce-a5fd-4785009ab67a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:16.720348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be4c5416-254c-4bce-a5fd-4785009ab67a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:16.850980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-be4c5416-254c-4bce-a5fd-4785009ab67a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:16.858333 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-be4c5416-254c-4bce-a5fd-4785009ab67a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150633 Jun 20 06:27:16.858896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 609/1206] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:16.999240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b1361653-0c47-418c-bb4c-7858706d91e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:16.999857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b1361653-0c47-418c-bb4c-7858706d91e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:17.006602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1361653-0c47-418c-bb4c-7858706d91e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:17.007058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1361653-0c47-418c-bb4c-7858706d91e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:17.007827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1361653-0c47-418c-bb4c-7858706d91e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:17.008266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1361653-0c47-418c-bb4c-7858706d91e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:17.069130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1361653-0c47-418c-bb4c-7858706d91e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:17.076667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b1361653-0c47-418c-bb4c-7858706d91e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081280 Jun 20 06:27:17.077236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 598/1207] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:16 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:17.878814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f045e94d-66fb-484f-a155-7e231ab0c6e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:17.879949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f045e94d-66fb-484f-a155-7e231ab0c6e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:17.886656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f045e94d-66fb-484f-a155-7e231ab0c6e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:17.887100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f045e94d-66fb-484f-a155-7e231ab0c6e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:17.887869 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f045e94d-66fb-484f-a155-7e231ab0c6e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:17.888287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f045e94d-66fb-484f-a155-7e231ab0c6e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:18.041141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f045e94d-66fb-484f-a155-7e231ab0c6e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:18.048808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f045e94d-66fb-484f-a155-7e231ab0c6e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.175863 Jun 20 06:27:18.049432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 610/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:17 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:18.093866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-edff7c13-e49f-43b7-af10-9d8419ba26e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:18.094478 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-edff7c13-e49f-43b7-af10-9d8419ba26e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:18.105699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edff7c13-e49f-43b7-af10-9d8419ba26e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:18.106153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edff7c13-e49f-43b7-af10-9d8419ba26e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:18.106936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edff7c13-e49f-43b7-af10-9d8419ba26e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:18.107376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edff7c13-e49f-43b7-af10-9d8419ba26e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:18.173967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-edff7c13-e49f-43b7-af10-9d8419ba26e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:18.185742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-edff7c13-e49f-43b7-af10-9d8419ba26e5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.095684 Jun 20 06:27:18.186313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 599/1209] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:18 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:19.069475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fd1764db-07b0-46dd-a8cf-eb8bf6d9f379 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:19.070091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fd1764db-07b0-46dd-a8cf-eb8bf6d9f379 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:19.076414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd1764db-07b0-46dd-a8cf-eb8bf6d9f379 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:19.076851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd1764db-07b0-46dd-a8cf-eb8bf6d9f379 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:19.077630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd1764db-07b0-46dd-a8cf-eb8bf6d9f379 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:19.078061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd1764db-07b0-46dd-a8cf-eb8bf6d9f379 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:19.203304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-145d1056-04eb-498a-bf41-c37a4aae4148 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:19.203928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-145d1056-04eb-498a-bf41-c37a4aae4148 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:19.210626 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-145d1056-04eb-498a-bf41-c37a4aae4148 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:19.211083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-145d1056-04eb-498a-bf41-c37a4aae4148 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:19.211404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fd1764db-07b0-46dd-a8cf-eb8bf6d9f379 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:19.211895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-145d1056-04eb-498a-bf41-c37a4aae4148 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:19.212340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-145d1056-04eb-498a-bf41-c37a4aae4148 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:19.218847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fd1764db-07b0-46dd-a8cf-eb8bf6d9f379 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153843 Jun 20 06:27:19.219412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 611/1210] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:19.276394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-145d1056-04eb-498a-bf41-c37a4aae4148 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:19.283810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-145d1056-04eb-498a-bf41-c37a4aae4148 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084404 Jun 20 06:27:19.284562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 600/1211] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:19 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:20.234844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bc52fc06-806c-4023-8483-04d54dd1f905 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:20.235452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bc52fc06-806c-4023-8483-04d54dd1f905 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:20.241944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc52fc06-806c-4023-8483-04d54dd1f905 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:20.242388 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc52fc06-806c-4023-8483-04d54dd1f905 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:20.243183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc52fc06-806c-4023-8483-04d54dd1f905 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:20.243612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc52fc06-806c-4023-8483-04d54dd1f905 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:20.300114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a115fc40-cf55-430b-b8ec-1fbb24fed684 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:20.300713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a115fc40-cf55-430b-b8ec-1fbb24fed684 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:20.307127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a115fc40-cf55-430b-b8ec-1fbb24fed684 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:20.307579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a115fc40-cf55-430b-b8ec-1fbb24fed684 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:20.308358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a115fc40-cf55-430b-b8ec-1fbb24fed684 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:20.308786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a115fc40-cf55-430b-b8ec-1fbb24fed684 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:20.381721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a115fc40-cf55-430b-b8ec-1fbb24fed684 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:20.389099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a115fc40-cf55-430b-b8ec-1fbb24fed684 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.092951 Jun 20 06:27:20.389707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 601/1212] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:20 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:20.400709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bc52fc06-806c-4023-8483-04d54dd1f905 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:20.408163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bc52fc06-806c-4023-8483-04d54dd1f905 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.177148 Jun 20 06:27:20.408717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 612/1213] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:21.406513 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9d37bf40-15d1-4446-ac11-3953f559c51d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:21.407118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9d37bf40-15d1-4446-ac11-3953f559c51d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:21.414286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d37bf40-15d1-4446-ac11-3953f559c51d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:21.414731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d37bf40-15d1-4446-ac11-3953f559c51d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:21.415480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d37bf40-15d1-4446-ac11-3953f559c51d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:21.415910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d37bf40-15d1-4446-ac11-3953f559c51d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:21.424164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d3272135-05d8-4f4e-b88e-eb4120eb650f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:21.425021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d3272135-05d8-4f4e-b88e-eb4120eb650f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:21.431911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3272135-05d8-4f4e-b88e-eb4120eb650f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:21.432357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3272135-05d8-4f4e-b88e-eb4120eb650f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:21.433121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3272135-05d8-4f4e-b88e-eb4120eb650f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:21.433590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3272135-05d8-4f4e-b88e-eb4120eb650f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:21.480221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9d37bf40-15d1-4446-ac11-3953f559c51d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:21.482498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:21.490525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9d37bf40-15d1-4446-ac11-3953f559c51d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087698 Jun 20 06:27:21.491510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 602/1214] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:21 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:21.580237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d3272135-05d8-4f4e-b88e-eb4120eb650f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:21.588237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d3272135-05d8-4f4e-b88e-eb4120eb650f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.167828 Jun 20 06:27:21.588765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 613/1215] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:22.508756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fb6e483a-c878-40d8-b84b-e477dd218735 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:22.509333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fb6e483a-c878-40d8-b84b-e477dd218735 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:22.515653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb6e483a-c878-40d8-b84b-e477dd218735 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:22.516095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb6e483a-c878-40d8-b84b-e477dd218735 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:22.517115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb6e483a-c878-40d8-b84b-e477dd218735 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:22.517574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb6e483a-c878-40d8-b84b-e477dd218735 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:22.579634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fb6e483a-c878-40d8-b84b-e477dd218735 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:22.587655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fb6e483a-c878-40d8-b84b-e477dd218735 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082774 Jun 20 06:27:22.588297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 603/1216] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:22 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:22.605920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-49244be5-1219-4b6c-a5bd-65d5494cfbf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:22.606540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-49244be5-1219-4b6c-a5bd-65d5494cfbf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:22.613833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49244be5-1219-4b6c-a5bd-65d5494cfbf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:22.614284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49244be5-1219-4b6c-a5bd-65d5494cfbf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:22.615048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49244be5-1219-4b6c-a5bd-65d5494cfbf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:22.615490 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49244be5-1219-4b6c-a5bd-65d5494cfbf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:22.743892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-49244be5-1219-4b6c-a5bd-65d5494cfbf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:22.751347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-49244be5-1219-4b6c-a5bd-65d5494cfbf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149288 Jun 20 06:27:22.751899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 614/1217] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:22 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:23.604653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-507c0619-aa08-4002-b727-28c9a4103474 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:23.605215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-507c0619-aa08-4002-b727-28c9a4103474 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:23.611714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-507c0619-aa08-4002-b727-28c9a4103474 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:23.612498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-507c0619-aa08-4002-b727-28c9a4103474 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:23.613268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-507c0619-aa08-4002-b727-28c9a4103474 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:23.613807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-507c0619-aa08-4002-b727-28c9a4103474 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:23.677106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-507c0619-aa08-4002-b727-28c9a4103474 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:23.684620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-507c0619-aa08-4002-b727-28c9a4103474 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083874 Jun 20 06:27:23.685179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 604/1218] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:23 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:23.769432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ae35aa84-b907-4787-9ef8-5e199d44575e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:23.770028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ae35aa84-b907-4787-9ef8-5e199d44575e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:23.776399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae35aa84-b907-4787-9ef8-5e199d44575e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:23.776838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae35aa84-b907-4787-9ef8-5e199d44575e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:23.777622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae35aa84-b907-4787-9ef8-5e199d44575e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:23.778091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae35aa84-b907-4787-9ef8-5e199d44575e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:23.906841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ae35aa84-b907-4787-9ef8-5e199d44575e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:23.914294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ae35aa84-b907-4787-9ef8-5e199d44575e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148994 Jun 20 06:27:23.914862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 615/1219] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:24.701891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4eb9a92a-a1fd-445a-b2ba-7443068763b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:24.702509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4eb9a92a-a1fd-445a-b2ba-7443068763b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:24.710038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4eb9a92a-a1fd-445a-b2ba-7443068763b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:24.710523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4eb9a92a-a1fd-445a-b2ba-7443068763b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:24.711291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4eb9a92a-a1fd-445a-b2ba-7443068763b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:24.711729 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4eb9a92a-a1fd-445a-b2ba-7443068763b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:24.771756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4eb9a92a-a1fd-445a-b2ba-7443068763b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:24.779122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4eb9a92a-a1fd-445a-b2ba-7443068763b6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081113 Jun 20 06:27:24.779686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 605/1220] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:24 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:24.931389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f33e926e-4370-484a-86bc-31f2cf3de95b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:24.931996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f33e926e-4370-484a-86bc-31f2cf3de95b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:24.938382 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f33e926e-4370-484a-86bc-31f2cf3de95b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:24.938831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f33e926e-4370-484a-86bc-31f2cf3de95b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:24.939588 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f33e926e-4370-484a-86bc-31f2cf3de95b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:24.940022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f33e926e-4370-484a-86bc-31f2cf3de95b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:25.070165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f33e926e-4370-484a-86bc-31f2cf3de95b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:25.077533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f33e926e-4370-484a-86bc-31f2cf3de95b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149979 Jun 20 06:27:25.078084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 616/1221] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:24 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:25.796608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c993843c-7c9e-485c-bea6-6d9f227fe515 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:25.797221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c993843c-7c9e-485c-bea6-6d9f227fe515 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:25.804019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c993843c-7c9e-485c-bea6-6d9f227fe515 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:25.804475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c993843c-7c9e-485c-bea6-6d9f227fe515 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:25.805242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c993843c-7c9e-485c-bea6-6d9f227fe515 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:25.805713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c993843c-7c9e-485c-bea6-6d9f227fe515 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:25.865508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c993843c-7c9e-485c-bea6-6d9f227fe515 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:25.872913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c993843c-7c9e-485c-bea6-6d9f227fe515 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080219 Jun 20 06:27:25.873504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 606/1222] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:25 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:26.095661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-aa5c827c-8cec-437a-9769-2741668b1cc2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:26.096219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-aa5c827c-8cec-437a-9769-2741668b1cc2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:26.103323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aa5c827c-8cec-437a-9769-2741668b1cc2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:26.103765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aa5c827c-8cec-437a-9769-2741668b1cc2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:26.104524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aa5c827c-8cec-437a-9769-2741668b1cc2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:26.104953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aa5c827c-8cec-437a-9769-2741668b1cc2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:26.233944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-aa5c827c-8cec-437a-9769-2741668b1cc2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:26.242274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-aa5c827c-8cec-437a-9769-2741668b1cc2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150584 Jun 20 06:27:26.242823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 617/1223] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:26.890253 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e240b28-d94c-448a-aa79-ef921cc38f34 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:26.890865 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5e240b28-d94c-448a-aa79-ef921cc38f34 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:26.898671 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e240b28-d94c-448a-aa79-ef921cc38f34 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:26.899120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e240b28-d94c-448a-aa79-ef921cc38f34 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:26.899884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e240b28-d94c-448a-aa79-ef921cc38f34 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:26.900318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e240b28-d94c-448a-aa79-ef921cc38f34 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:26.963985 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e240b28-d94c-448a-aa79-ef921cc38f34 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:26.971435 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e240b28-d94c-448a-aa79-ef921cc38f34 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084992 Jun 20 06:27:26.972899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 607/1224] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:26 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:27.259784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9369b4b1-56b5-44a3-b864-2de97281ad2a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:27.260333 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9369b4b1-56b5-44a3-b864-2de97281ad2a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:27.267198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9369b4b1-56b5-44a3-b864-2de97281ad2a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:27.267640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9369b4b1-56b5-44a3-b864-2de97281ad2a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:27.269215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9369b4b1-56b5-44a3-b864-2de97281ad2a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:27.269711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9369b4b1-56b5-44a3-b864-2de97281ad2a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:27.397028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9369b4b1-56b5-44a3-b864-2de97281ad2a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:27.404413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9369b4b1-56b5-44a3-b864-2de97281ad2a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148587 Jun 20 06:27:27.404967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 618/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:27 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:27.989690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-68f5904c-9fae-4052-82b5-a78b3611480d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:27.990251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-68f5904c-9fae-4052-82b5-a78b3611480d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:27.996568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68f5904c-9fae-4052-82b5-a78b3611480d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:27.997017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68f5904c-9fae-4052-82b5-a78b3611480d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:27.997810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68f5904c-9fae-4052-82b5-a78b3611480d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:27.998246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68f5904c-9fae-4052-82b5-a78b3611480d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:28.061100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-68f5904c-9fae-4052-82b5-a78b3611480d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:28.068767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-68f5904c-9fae-4052-82b5-a78b3611480d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083896 Jun 20 06:27:28.069331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 608/1226] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:27 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:28.421605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-883c1530-3bd8-478f-904a-33720366659b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:28.422220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-883c1530-3bd8-478f-904a-33720366659b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:28.429172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-883c1530-3bd8-478f-904a-33720366659b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:28.429645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-883c1530-3bd8-478f-904a-33720366659b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:28.430401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-883c1530-3bd8-478f-904a-33720366659b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:28.430830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-883c1530-3bd8-478f-904a-33720366659b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:28.563444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-883c1530-3bd8-478f-904a-33720366659b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:28.570943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-883c1530-3bd8-478f-904a-33720366659b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153244 Jun 20 06:27:28.571499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 619/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:28 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:29.085733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-241dabc6-5eb9-4a49-8716-f13e4304368c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:29.086359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-241dabc6-5eb9-4a49-8716-f13e4304368c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:29.092432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-241dabc6-5eb9-4a49-8716-f13e4304368c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:29.092919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-241dabc6-5eb9-4a49-8716-f13e4304368c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:29.093719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-241dabc6-5eb9-4a49-8716-f13e4304368c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:29.094219 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-241dabc6-5eb9-4a49-8716-f13e4304368c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:29.155393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-241dabc6-5eb9-4a49-8716-f13e4304368c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:29.163863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-241dabc6-5eb9-4a49-8716-f13e4304368c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083083 Jun 20 06:27:29.164424 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 609/1228] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:29 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:29.588033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3885bb61-e479-444b-895e-b7b3b6196286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:29.588577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3885bb61-e479-444b-895e-b7b3b6196286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:29.595076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3885bb61-e479-444b-895e-b7b3b6196286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:29.595525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3885bb61-e479-444b-895e-b7b3b6196286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:29.596329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3885bb61-e479-444b-895e-b7b3b6196286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:29.596782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3885bb61-e479-444b-895e-b7b3b6196286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:29.726036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3885bb61-e479-444b-895e-b7b3b6196286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:29.733431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3885bb61-e479-444b-895e-b7b3b6196286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149308 Jun 20 06:27:29.733991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 620/1229] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:30.180990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9d16ef8d-c3f9-4462-a0ea-94a86d95b504 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:30.181696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9d16ef8d-c3f9-4462-a0ea-94a86d95b504 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:30.188076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d16ef8d-c3f9-4462-a0ea-94a86d95b504 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:30.188524 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d16ef8d-c3f9-4462-a0ea-94a86d95b504 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:30.189280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d16ef8d-c3f9-4462-a0ea-94a86d95b504 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:30.189742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d16ef8d-c3f9-4462-a0ea-94a86d95b504 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:30.253328 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9d16ef8d-c3f9-4462-a0ea-94a86d95b504 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:30.260759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9d16ef8d-c3f9-4462-a0ea-94a86d95b504 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083590 Jun 20 06:27:30.261322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 610/1230] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:30 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:30.751733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a3737e9f-aad7-431e-a4ad-91ad6770aab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:30.752278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a3737e9f-aad7-431e-a4ad-91ad6770aab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:30.758750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3737e9f-aad7-431e-a4ad-91ad6770aab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:30.759198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3737e9f-aad7-431e-a4ad-91ad6770aab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:30.759954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3737e9f-aad7-431e-a4ad-91ad6770aab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:30.760391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3737e9f-aad7-431e-a4ad-91ad6770aab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:30.762893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:30.891471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a3737e9f-aad7-431e-a4ad-91ad6770aab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:30.899648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a3737e9f-aad7-431e-a4ad-91ad6770aab0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151879 Jun 20 06:27:30.900202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 621/1231] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:31.278169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f262cb02-f91c-4e15-b6b6-6d178582b958 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:31.278821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f262cb02-f91c-4e15-b6b6-6d178582b958 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:31.286176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f262cb02-f91c-4e15-b6b6-6d178582b958 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:31.286633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f262cb02-f91c-4e15-b6b6-6d178582b958 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:31.287493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f262cb02-f91c-4e15-b6b6-6d178582b958 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:31.287938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f262cb02-f91c-4e15-b6b6-6d178582b958 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:31.349922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f262cb02-f91c-4e15-b6b6-6d178582b958 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:31.357363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f262cb02-f91c-4e15-b6b6-6d178582b958 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083104 Jun 20 06:27:31.357945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 611/1232] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:31 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:31.916144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e6691950-2d95-4bb4-ab47-24413f5bdee3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:31.917220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e6691950-2d95-4bb4-ab47-24413f5bdee3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:31.923673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6691950-2d95-4bb4-ab47-24413f5bdee3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:31.924120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6691950-2d95-4bb4-ab47-24413f5bdee3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:31.925421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6691950-2d95-4bb4-ab47-24413f5bdee3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:31.925861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6691950-2d95-4bb4-ab47-24413f5bdee3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:32.061728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e6691950-2d95-4bb4-ab47-24413f5bdee3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:32.070314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e6691950-2d95-4bb4-ab47-24413f5bdee3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157984 Jun 20 06:27:32.070874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 622/1233] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:31 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:32.374207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0bc24868-96da-48f3-946a-55a247baeb8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:32.374847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0bc24868-96da-48f3-946a-55a247baeb8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:32.381281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bc24868-96da-48f3-946a-55a247baeb8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:32.381768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bc24868-96da-48f3-946a-55a247baeb8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:32.382524 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bc24868-96da-48f3-946a-55a247baeb8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:32.382956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bc24868-96da-48f3-946a-55a247baeb8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:32.442681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0bc24868-96da-48f3-946a-55a247baeb8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:32.450331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0bc24868-96da-48f3-946a-55a247baeb8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.079974 Jun 20 06:27:32.450892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 612/1234] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:32 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:33.087689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e6d7506b-b199-4e12-a0f3-8b92f6c52984 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:33.088286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e6d7506b-b199-4e12-a0f3-8b92f6c52984 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:33.094330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6d7506b-b199-4e12-a0f3-8b92f6c52984 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:33.094774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6d7506b-b199-4e12-a0f3-8b92f6c52984 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:33.095523 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6d7506b-b199-4e12-a0f3-8b92f6c52984 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:33.095950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6d7506b-b199-4e12-a0f3-8b92f6c52984 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:33.224228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e6d7506b-b199-4e12-a0f3-8b92f6c52984 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:33.231995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e6d7506b-b199-4e12-a0f3-8b92f6c52984 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148336 Jun 20 06:27:33.232555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 623/1235] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:33 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:33.467021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4009b8ac-f693-40cf-a5af-73e91760c79b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:33.467661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4009b8ac-f693-40cf-a5af-73e91760c79b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:33.474612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4009b8ac-f693-40cf-a5af-73e91760c79b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:33.475066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4009b8ac-f693-40cf-a5af-73e91760c79b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:33.475831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4009b8ac-f693-40cf-a5af-73e91760c79b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:33.476265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4009b8ac-f693-40cf-a5af-73e91760c79b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:33.540392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4009b8ac-f693-40cf-a5af-73e91760c79b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:33.547848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4009b8ac-f693-40cf-a5af-73e91760c79b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084704 Jun 20 06:27:33.548435 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 613/1236] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:33 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:34.250006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a662590a-e744-4b8d-9ada-13c362373177 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:34.250667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a662590a-e744-4b8d-9ada-13c362373177 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:34.257587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a662590a-e744-4b8d-9ada-13c362373177 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:34.258039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a662590a-e744-4b8d-9ada-13c362373177 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:34.258798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a662590a-e744-4b8d-9ada-13c362373177 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:34.259230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a662590a-e744-4b8d-9ada-13c362373177 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:34.388579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a662590a-e744-4b8d-9ada-13c362373177 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:34.396983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a662590a-e744-4b8d-9ada-13c362373177 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150834 Jun 20 06:27:34.397575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 624/1237] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:34.566282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9503e543-7757-4760-b15a-ed1dcfb766b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:34.566830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9503e543-7757-4760-b15a-ed1dcfb766b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:34.573504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9503e543-7757-4760-b15a-ed1dcfb766b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:34.573950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9503e543-7757-4760-b15a-ed1dcfb766b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:34.574706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9503e543-7757-4760-b15a-ed1dcfb766b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:34.575139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9503e543-7757-4760-b15a-ed1dcfb766b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:34.638400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9503e543-7757-4760-b15a-ed1dcfb766b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:34.646881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9503e543-7757-4760-b15a-ed1dcfb766b9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085508 Jun 20 06:27:34.647425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 614/1238] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:34 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:35.414763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e2980988-0d21-4be5-af6f-6b2d328369a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:35.415365 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e2980988-0d21-4be5-af6f-6b2d328369a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:35.421739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e2980988-0d21-4be5-af6f-6b2d328369a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:35.422178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e2980988-0d21-4be5-af6f-6b2d328369a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:35.422921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e2980988-0d21-4be5-af6f-6b2d328369a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:35.423348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e2980988-0d21-4be5-af6f-6b2d328369a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:35.555143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e2980988-0d21-4be5-af6f-6b2d328369a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:35.562537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e2980988-0d21-4be5-af6f-6b2d328369a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151647 Jun 20 06:27:35.563105 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 625/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:35 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:35.664475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d421379f-bdc7-47e8-a34b-24a062c9e16a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:35.665091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d421379f-bdc7-47e8-a34b-24a062c9e16a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:35.671576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d421379f-bdc7-47e8-a34b-24a062c9e16a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:35.672028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d421379f-bdc7-47e8-a34b-24a062c9e16a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:35.672786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d421379f-bdc7-47e8-a34b-24a062c9e16a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:35.673224 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d421379f-bdc7-47e8-a34b-24a062c9e16a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:35.735277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d421379f-bdc7-47e8-a34b-24a062c9e16a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:35.742725 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d421379f-bdc7-47e8-a34b-24a062c9e16a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082076 Jun 20 06:27:35.743292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 615/1240] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:35 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:36.580152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df1d2937-4127-469c-851e-0fea6040b702 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:36.581938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-df1d2937-4127-469c-851e-0fea6040b702 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:36.587537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df1d2937-4127-469c-851e-0fea6040b702 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:36.587987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df1d2937-4127-469c-851e-0fea6040b702 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:36.588752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df1d2937-4127-469c-851e-0fea6040b702 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:36.589187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df1d2937-4127-469c-851e-0fea6040b702 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:36.716379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-df1d2937-4127-469c-851e-0fea6040b702 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:36.724894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-df1d2937-4127-469c-851e-0fea6040b702 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148085 Jun 20 06:27:36.725736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 626/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:36.759787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d1afbfe6-0896-43ff-a0b5-8c536b43710c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:36.760457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d1afbfe6-0896-43ff-a0b5-8c536b43710c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:36.768526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1afbfe6-0896-43ff-a0b5-8c536b43710c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:36.768696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1afbfe6-0896-43ff-a0b5-8c536b43710c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:36.769441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1afbfe6-0896-43ff-a0b5-8c536b43710c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:36.769935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1afbfe6-0896-43ff-a0b5-8c536b43710c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:36.835013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d1afbfe6-0896-43ff-a0b5-8c536b43710c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:36.842476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d1afbfe6-0896-43ff-a0b5-8c536b43710c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086694 Jun 20 06:27:36.843038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 616/1242] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:36 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:37.742301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc4df5ab-d7bf-4281-90c9-4d751978720b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:37.742912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc4df5ab-d7bf-4281-90c9-4d751978720b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:37.749317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc4df5ab-d7bf-4281-90c9-4d751978720b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:37.749789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc4df5ab-d7bf-4281-90c9-4d751978720b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:37.750536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc4df5ab-d7bf-4281-90c9-4d751978720b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:37.750969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc4df5ab-d7bf-4281-90c9-4d751978720b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:37.859493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e21fb0fc-7e33-4fb9-9936-38f58fbb1457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:37.860123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e21fb0fc-7e33-4fb9-9936-38f58fbb1457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:37.866588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e21fb0fc-7e33-4fb9-9936-38f58fbb1457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:37.867060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e21fb0fc-7e33-4fb9-9936-38f58fbb1457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:37.868081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e21fb0fc-7e33-4fb9-9936-38f58fbb1457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:37.868519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e21fb0fc-7e33-4fb9-9936-38f58fbb1457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:37.883749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc4df5ab-d7bf-4281-90c9-4d751978720b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:37.894053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc4df5ab-d7bf-4281-90c9-4d751978720b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154715 Jun 20 06:27:37.894627 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 627/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:37.932302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e21fb0fc-7e33-4fb9-9936-38f58fbb1457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:37.939692 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e21fb0fc-7e33-4fb9-9936-38f58fbb1457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084032 Jun 20 06:27:37.941404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 617/1244] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:37 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:38.911274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0029358c-7248-4582-bfe0-94aa024c80e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:38.911881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0029358c-7248-4582-bfe0-94aa024c80e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:38.918297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0029358c-7248-4582-bfe0-94aa024c80e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:38.918743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0029358c-7248-4582-bfe0-94aa024c80e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:38.919499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0029358c-7248-4582-bfe0-94aa024c80e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:38.919930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0029358c-7248-4582-bfe0-94aa024c80e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:38.957177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-93421795-0b66-4621-a46d-1fd7dd001906 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:38.957818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-93421795-0b66-4621-a46d-1fd7dd001906 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:38.964928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93421795-0b66-4621-a46d-1fd7dd001906 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:38.965107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93421795-0b66-4621-a46d-1fd7dd001906 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:38.965944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93421795-0b66-4621-a46d-1fd7dd001906 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:38.966405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93421795-0b66-4621-a46d-1fd7dd001906 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:39.044450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93421795-0b66-4621-a46d-1fd7dd001906 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:39.052599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-93421795-0b66-4621-a46d-1fd7dd001906 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.099099 Jun 20 06:27:39.053170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 618/1245] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:38 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:39.077813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0029358c-7248-4582-bfe0-94aa024c80e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:39.086038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0029358c-7248-4582-bfe0-94aa024c80e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.178702 Jun 20 06:27:39.086600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 628/1246] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:38 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:40.069081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a11da470-9163-49e7-bece-dcdcb7901cd2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:40.069722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a11da470-9163-49e7-bece-dcdcb7901cd2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:40.076361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a11da470-9163-49e7-bece-dcdcb7901cd2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:40.076813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a11da470-9163-49e7-bece-dcdcb7901cd2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:40.077615 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a11da470-9163-49e7-bece-dcdcb7901cd2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:40.078079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a11da470-9163-49e7-bece-dcdcb7901cd2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:40.093474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:40.103137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad2bbc3d-bd11-41c7-83df-10a69ec6fe46 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:40.103749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ad2bbc3d-bd11-41c7-83df-10a69ec6fe46 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:40.109904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad2bbc3d-bd11-41c7-83df-10a69ec6fe46 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:40.110357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad2bbc3d-bd11-41c7-83df-10a69ec6fe46 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:40.111123 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad2bbc3d-bd11-41c7-83df-10a69ec6fe46 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:40.111579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad2bbc3d-bd11-41c7-83df-10a69ec6fe46 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:40.140315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a11da470-9163-49e7-bece-dcdcb7901cd2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:40.149115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a11da470-9163-49e7-bece-dcdcb7901cd2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084364 Jun 20 06:27:40.149720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 619/1247] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:40 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:40.247639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ad2bbc3d-bd11-41c7-83df-10a69ec6fe46 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:40.256103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ad2bbc3d-bd11-41c7-83df-10a69ec6fe46 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156775 Jun 20 06:27:40.256664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 629/1248] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:41.165702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0a1a4019-7dad-4ea7-94ed-974590e990af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:41.166308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0a1a4019-7dad-4ea7-94ed-974590e990af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:41.172749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a1a4019-7dad-4ea7-94ed-974590e990af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:41.173194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a1a4019-7dad-4ea7-94ed-974590e990af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:41.173983 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a1a4019-7dad-4ea7-94ed-974590e990af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:41.174940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a1a4019-7dad-4ea7-94ed-974590e990af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:41.238022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0a1a4019-7dad-4ea7-94ed-974590e990af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:41.245366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0a1a4019-7dad-4ea7-94ed-974590e990af tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083571 Jun 20 06:27:41.245949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 620/1249] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:41 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:41.272501 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e0b3c7d9-95e2-4b61-a684-405553cfc85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:41.273117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e0b3c7d9-95e2-4b61-a684-405553cfc85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:41.275439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:41.280820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0b3c7d9-95e2-4b61-a684-405553cfc85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:41.281266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0b3c7d9-95e2-4b61-a684-405553cfc85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:41.282057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0b3c7d9-95e2-4b61-a684-405553cfc85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:41.282492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0b3c7d9-95e2-4b61-a684-405553cfc85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:41.415051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e0b3c7d9-95e2-4b61-a684-405553cfc85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:41.422608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e0b3c7d9-95e2-4b61-a684-405553cfc85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154047 Jun 20 06:27:41.423112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 630/1250] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:42.262901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e085cbe3-d491-47ec-a2e3-0295bb8cba21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:42.263431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e085cbe3-d491-47ec-a2e3-0295bb8cba21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:42.270573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e085cbe3-d491-47ec-a2e3-0295bb8cba21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:42.271030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e085cbe3-d491-47ec-a2e3-0295bb8cba21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:42.271788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e085cbe3-d491-47ec-a2e3-0295bb8cba21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:42.272225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e085cbe3-d491-47ec-a2e3-0295bb8cba21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:42.336916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e085cbe3-d491-47ec-a2e3-0295bb8cba21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:42.344540 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e085cbe3-d491-47ec-a2e3-0295bb8cba21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085568 Jun 20 06:27:42.345099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 621/1251] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:42 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:42.440302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-61637345-3737-40c1-ad7b-4a1ba0b42cbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:42.440918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-61637345-3737-40c1-ad7b-4a1ba0b42cbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:42.447884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61637345-3737-40c1-ad7b-4a1ba0b42cbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:42.447884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61637345-3737-40c1-ad7b-4a1ba0b42cbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:42.448608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61637345-3737-40c1-ad7b-4a1ba0b42cbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:42.449049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61637345-3737-40c1-ad7b-4a1ba0b42cbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:42.585360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-61637345-3737-40c1-ad7b-4a1ba0b42cbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:42.592892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-61637345-3737-40c1-ad7b-4a1ba0b42cbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156623 Jun 20 06:27:42.593492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 631/1252] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:42 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:43.362954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-119c3082-5aa1-4c60-98c7-34250a1c55d0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:43.363559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-119c3082-5aa1-4c60-98c7-34250a1c55d0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:43.366000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:43.371206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-119c3082-5aa1-4c60-98c7-34250a1c55d0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:43.371651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-119c3082-5aa1-4c60-98c7-34250a1c55d0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:43.372407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-119c3082-5aa1-4c60-98c7-34250a1c55d0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:43.372836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-119c3082-5aa1-4c60-98c7-34250a1c55d0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:43.434245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-119c3082-5aa1-4c60-98c7-34250a1c55d0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:43.442354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-119c3082-5aa1-4c60-98c7-34250a1c55d0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083752 Jun 20 06:27:43.442918 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 622/1253] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:43 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:43.611020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9969cea5-f48a-412e-a0c3-cb6359611945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:43.611607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9969cea5-f48a-412e-a0c3-cb6359611945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:43.618825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9969cea5-f48a-412e-a0c3-cb6359611945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:43.619301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9969cea5-f48a-412e-a0c3-cb6359611945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:43.620062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9969cea5-f48a-412e-a0c3-cb6359611945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:43.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9969cea5-f48a-412e-a0c3-cb6359611945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:43.753914 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9969cea5-f48a-412e-a0c3-cb6359611945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:43.761401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9969cea5-f48a-412e-a0c3-cb6359611945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154337 Jun 20 06:27:43.761954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 632/1254] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:44.458553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d82e85a-710f-412c-b7ae-a24f392dfe2c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:44.459156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d82e85a-710f-412c-b7ae-a24f392dfe2c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:44.465905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d82e85a-710f-412c-b7ae-a24f392dfe2c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:44.466363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d82e85a-710f-412c-b7ae-a24f392dfe2c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:44.467135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d82e85a-710f-412c-b7ae-a24f392dfe2c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:44.467610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d82e85a-710f-412c-b7ae-a24f392dfe2c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:44.532967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d82e85a-710f-412c-b7ae-a24f392dfe2c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:44.541229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d82e85a-710f-412c-b7ae-a24f392dfe2c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086596 Jun 20 06:27:44.541836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 623/1255] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:44 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:44.778614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5a942ccf-5922-45f4-89e4-0e910c87a920 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:44.779257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5a942ccf-5922-45f4-89e4-0e910c87a920 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:44.786194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a942ccf-5922-45f4-89e4-0e910c87a920 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:44.786642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a942ccf-5922-45f4-89e4-0e910c87a920 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:44.787403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a942ccf-5922-45f4-89e4-0e910c87a920 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:44.787837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a942ccf-5922-45f4-89e4-0e910c87a920 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:44.916620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a942ccf-5922-45f4-89e4-0e910c87a920 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:44.924748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5a942ccf-5922-45f4-89e4-0e910c87a920 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149391 Jun 20 06:27:44.925301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 633/1256] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:45.558797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-696eecf0-5128-4e07-9afc-03a075ee61c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:45.559410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-696eecf0-5128-4e07-9afc-03a075ee61c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:45.565975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-696eecf0-5128-4e07-9afc-03a075ee61c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:45.566423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-696eecf0-5128-4e07-9afc-03a075ee61c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:45.567188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-696eecf0-5128-4e07-9afc-03a075ee61c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:45.567632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-696eecf0-5128-4e07-9afc-03a075ee61c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:45.627877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-696eecf0-5128-4e07-9afc-03a075ee61c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:45.635334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-696eecf0-5128-4e07-9afc-03a075ee61c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080452 Jun 20 06:27:45.635899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 624/1257] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:45 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:45.941995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-53b2b194-25e1-465c-8d19-305ca3e80f52 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:45.942613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-53b2b194-25e1-465c-8d19-305ca3e80f52 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:45.949055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53b2b194-25e1-465c-8d19-305ca3e80f52 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:45.949535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53b2b194-25e1-465c-8d19-305ca3e80f52 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:45.950296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53b2b194-25e1-465c-8d19-305ca3e80f52 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:45.950729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53b2b194-25e1-465c-8d19-305ca3e80f52 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:46.082259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-53b2b194-25e1-465c-8d19-305ca3e80f52 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:46.089683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-53b2b194-25e1-465c-8d19-305ca3e80f52 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152465 Jun 20 06:27:46.090236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 634/1258] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:46.652126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60a35d52-be73-4163-9fcb-7a6ecd0240f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:46.652736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-60a35d52-be73-4163-9fcb-7a6ecd0240f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:46.659680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60a35d52-be73-4163-9fcb-7a6ecd0240f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:46.660136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60a35d52-be73-4163-9fcb-7a6ecd0240f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:46.660979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60a35d52-be73-4163-9fcb-7a6ecd0240f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:46.661446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60a35d52-be73-4163-9fcb-7a6ecd0240f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:46.721357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-60a35d52-be73-4163-9fcb-7a6ecd0240f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:46.728802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-60a35d52-be73-4163-9fcb-7a6ecd0240f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080561 Jun 20 06:27:46.729365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 625/1259] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:46 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:47.107267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-daf2d970-0ee2-45e1-b778-7a0abb2835c3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:47.107883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-daf2d970-0ee2-45e1-b778-7a0abb2835c3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:47.114851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-daf2d970-0ee2-45e1-b778-7a0abb2835c3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:47.115305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-daf2d970-0ee2-45e1-b778-7a0abb2835c3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:47.116074 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-daf2d970-0ee2-45e1-b778-7a0abb2835c3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:47.116512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-daf2d970-0ee2-45e1-b778-7a0abb2835c3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:47.248778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-daf2d970-0ee2-45e1-b778-7a0abb2835c3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:47.256283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-daf2d970-0ee2-45e1-b778-7a0abb2835c3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152905 Jun 20 06:27:47.256838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 635/1260] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:47.745859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c4dc032-9940-48e5-b625-76be7e641d96 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:47.746463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c4dc032-9940-48e5-b625-76be7e641d96 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:47.753930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c4dc032-9940-48e5-b625-76be7e641d96 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:47.754377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c4dc032-9940-48e5-b625-76be7e641d96 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:47.755132 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c4dc032-9940-48e5-b625-76be7e641d96 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:47.755569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c4dc032-9940-48e5-b625-76be7e641d96 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:47.819547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c4dc032-9940-48e5-b625-76be7e641d96 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:47.827103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c4dc032-9940-48e5-b625-76be7e641d96 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085081 Jun 20 06:27:47.827659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 626/1261] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:47 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:48.274064 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-99b3f49b-3707-48a4-a6a8-95a9d617a007 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:48.274680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-99b3f49b-3707-48a4-a6a8-95a9d617a007 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:48.281093 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b3f49b-3707-48a4-a6a8-95a9d617a007 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:48.281568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b3f49b-3707-48a4-a6a8-95a9d617a007 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:48.282328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b3f49b-3707-48a4-a6a8-95a9d617a007 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:48.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b3f49b-3707-48a4-a6a8-95a9d617a007 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:48.414114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-99b3f49b-3707-48a4-a6a8-95a9d617a007 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:48.421593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-99b3f49b-3707-48a4-a6a8-95a9d617a007 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151319 Jun 20 06:27:48.422147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 636/1262] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:48.843600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0349aaad-4da8-4a15-8b20-2bd40eb63fec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:48.844210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0349aaad-4da8-4a15-8b20-2bd40eb63fec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:48.851242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0349aaad-4da8-4a15-8b20-2bd40eb63fec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:48.851696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0349aaad-4da8-4a15-8b20-2bd40eb63fec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:48.852465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0349aaad-4da8-4a15-8b20-2bd40eb63fec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:48.852909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0349aaad-4da8-4a15-8b20-2bd40eb63fec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:48.913915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0349aaad-4da8-4a15-8b20-2bd40eb63fec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:48.921643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0349aaad-4da8-4a15-8b20-2bd40eb63fec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081856 Jun 20 06:27:48.922208 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 627/1263] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:48 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:49.438850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df985459-b516-49d7-b605-ddf0abc4b663 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:49.439466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-df985459-b516-49d7-b605-ddf0abc4b663 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:49.446289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df985459-b516-49d7-b605-ddf0abc4b663 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:49.446737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df985459-b516-49d7-b605-ddf0abc4b663 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:49.447494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df985459-b516-49d7-b605-ddf0abc4b663 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:49.447929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df985459-b516-49d7-b605-ddf0abc4b663 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:49.583884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-df985459-b516-49d7-b605-ddf0abc4b663 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:49.586086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:49.592781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-df985459-b516-49d7-b605-ddf0abc4b663 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157788 Jun 20 06:27:49.593348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 637/1264] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:49.942054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-84b5976a-108a-4cfe-b1a7-001d3e3fb037 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:49.942726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-84b5976a-108a-4cfe-b1a7-001d3e3fb037 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:49.949058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84b5976a-108a-4cfe-b1a7-001d3e3fb037 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:49.949543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84b5976a-108a-4cfe-b1a7-001d3e3fb037 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:49.950304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84b5976a-108a-4cfe-b1a7-001d3e3fb037 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:49.950739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84b5976a-108a-4cfe-b1a7-001d3e3fb037 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:50.013363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84b5976a-108a-4cfe-b1a7-001d3e3fb037 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:50.021135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-84b5976a-108a-4cfe-b1a7-001d3e3fb037 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084090 Jun 20 06:27:50.021729 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 628/1265] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:49 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:50.059566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:27:50.059723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:27:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:27:50.611137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f9599c42-faa8-4d8c-b7a7-5c11b69d73ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:50.611847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f9599c42-faa8-4d8c-b7a7-5c11b69d73ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:50.618231 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9599c42-faa8-4d8c-b7a7-5c11b69d73ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:50.618668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9599c42-faa8-4d8c-b7a7-5c11b69d73ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:50.619418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9599c42-faa8-4d8c-b7a7-5c11b69d73ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:50.619846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9599c42-faa8-4d8c-b7a7-5c11b69d73ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:50.750413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f9599c42-faa8-4d8c-b7a7-5c11b69d73ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:50.758557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f9599c42-faa8-4d8c-b7a7-5c11b69d73ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151490 Jun 20 06:27:50.759115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 638/1266] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:51.038214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-615ef568-6136-41dc-a3e5-aaa04bd037f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:51.039814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-615ef568-6136-41dc-a3e5-aaa04bd037f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:51.046236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-615ef568-6136-41dc-a3e5-aaa04bd037f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:51.046687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-615ef568-6136-41dc-a3e5-aaa04bd037f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:51.047437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-615ef568-6136-41dc-a3e5-aaa04bd037f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:51.047870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-615ef568-6136-41dc-a3e5-aaa04bd037f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:51.110723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-615ef568-6136-41dc-a3e5-aaa04bd037f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:51.118909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-615ef568-6136-41dc-a3e5-aaa04bd037f3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085436 Jun 20 06:27:51.119463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 629/1267] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:51 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:51.776917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-583f5434-ebe1-471d-b589-202f19b7acd2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:51.777550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-583f5434-ebe1-471d-b589-202f19b7acd2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:51.784787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-583f5434-ebe1-471d-b589-202f19b7acd2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:51.785223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-583f5434-ebe1-471d-b589-202f19b7acd2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:51.786003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-583f5434-ebe1-471d-b589-202f19b7acd2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:51.786434 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-583f5434-ebe1-471d-b589-202f19b7acd2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:51.917852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-583f5434-ebe1-471d-b589-202f19b7acd2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:51.925265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-583f5434-ebe1-471d-b589-202f19b7acd2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152921 Jun 20 06:27:51.925874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 639/1268] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:52.135384 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0484f69f-054e-4ece-b64f-dbe23e359033 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:52.136007 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0484f69f-054e-4ece-b64f-dbe23e359033 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:52.143321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0484f69f-054e-4ece-b64f-dbe23e359033 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:52.143776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0484f69f-054e-4ece-b64f-dbe23e359033 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:52.144551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0484f69f-054e-4ece-b64f-dbe23e359033 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:52.144992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0484f69f-054e-4ece-b64f-dbe23e359033 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:52.204843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0484f69f-054e-4ece-b64f-dbe23e359033 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:52.212466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0484f69f-054e-4ece-b64f-dbe23e359033 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080971 Jun 20 06:27:52.213024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 630/1269] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:52 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:52.942856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-725380b9-3de5-4ca4-93c7-63eefaba50ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:52.943502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-725380b9-3de5-4ca4-93c7-63eefaba50ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:52.949874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725380b9-3de5-4ca4-93c7-63eefaba50ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:52.950313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725380b9-3de5-4ca4-93c7-63eefaba50ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:52.951063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725380b9-3de5-4ca4-93c7-63eefaba50ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:52.951491 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725380b9-3de5-4ca4-93c7-63eefaba50ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:53.082644 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-725380b9-3de5-4ca4-93c7-63eefaba50ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:53.089973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-725380b9-3de5-4ca4-93c7-63eefaba50ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151185 Jun 20 06:27:53.090536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 640/1270] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:53.229026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5253846a-3a36-4c11-aa08-bbefc59a3c40 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:53.229574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5253846a-3a36-4c11-aa08-bbefc59a3c40 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:53.236072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5253846a-3a36-4c11-aa08-bbefc59a3c40 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:53.236572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5253846a-3a36-4c11-aa08-bbefc59a3c40 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:53.237547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5253846a-3a36-4c11-aa08-bbefc59a3c40 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:53.237970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5253846a-3a36-4c11-aa08-bbefc59a3c40 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:53.298360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5253846a-3a36-4c11-aa08-bbefc59a3c40 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:53.305791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5253846a-3a36-4c11-aa08-bbefc59a3c40 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080645 Jun 20 06:27:53.306347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 631/1271] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:53 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:54.106880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-49713b1a-815e-4e1a-b4d2-f3e327f59c93 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:54.107497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-49713b1a-815e-4e1a-b4d2-f3e327f59c93 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:54.115169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49713b1a-815e-4e1a-b4d2-f3e327f59c93 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:54.115614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49713b1a-815e-4e1a-b4d2-f3e327f59c93 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:54.116373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49713b1a-815e-4e1a-b4d2-f3e327f59c93 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:54.116820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49713b1a-815e-4e1a-b4d2-f3e327f59c93 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:54.244390 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-49713b1a-815e-4e1a-b4d2-f3e327f59c93 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:54.252168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-49713b1a-815e-4e1a-b4d2-f3e327f59c93 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148840 Jun 20 06:27:54.252631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 641/1272] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:54.322775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7867ffee-17c4-4233-bc80-acc8ceb3a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:54.323377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7867ffee-17c4-4233-bc80-acc8ceb3a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:54.330713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7867ffee-17c4-4233-bc80-acc8ceb3a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:54.331412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7867ffee-17c4-4233-bc80-acc8ceb3a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:54.331924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7867ffee-17c4-4233-bc80-acc8ceb3a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:54.332355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7867ffee-17c4-4233-bc80-acc8ceb3a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:54.396314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7867ffee-17c4-4233-bc80-acc8ceb3a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:54.403712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7867ffee-17c4-4233-bc80-acc8ceb3a921 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084785 Jun 20 06:27:54.404266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 632/1273] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:54 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:55.269293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f961a0ed-93a9-44d2-8263-ab73ede7f5b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:55.269947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f961a0ed-93a9-44d2-8263-ab73ede7f5b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:55.276399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f961a0ed-93a9-44d2-8263-ab73ede7f5b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:55.276838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f961a0ed-93a9-44d2-8263-ab73ede7f5b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:55.277622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f961a0ed-93a9-44d2-8263-ab73ede7f5b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:55.278048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f961a0ed-93a9-44d2-8263-ab73ede7f5b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:55.407713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f961a0ed-93a9-44d2-8263-ab73ede7f5b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:55.415175 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f961a0ed-93a9-44d2-8263-ab73ede7f5b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150244 Jun 20 06:27:55.415909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 642/1274] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:55.420973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0b00e7e4-c9cf-4e96-a56a-d47af0737f33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:55.421703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0b00e7e4-c9cf-4e96-a56a-d47af0737f33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:55.428881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b00e7e4-c9cf-4e96-a56a-d47af0737f33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:55.429327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b00e7e4-c9cf-4e96-a56a-d47af0737f33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:55.430118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b00e7e4-c9cf-4e96-a56a-d47af0737f33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:55.430559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b00e7e4-c9cf-4e96-a56a-d47af0737f33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:55.491039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0b00e7e4-c9cf-4e96-a56a-d47af0737f33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:55.498449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0b00e7e4-c9cf-4e96-a56a-d47af0737f33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081228 Jun 20 06:27:55.499004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 633/1275] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:55 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:56.432922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e24c01ed-d278-426b-bedc-6601defed41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:56.433613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e24c01ed-d278-426b-bedc-6601defed41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:56.440862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e24c01ed-d278-426b-bedc-6601defed41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:56.441313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e24c01ed-d278-426b-bedc-6601defed41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:56.442104 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e24c01ed-d278-426b-bedc-6601defed41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:56.442539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e24c01ed-d278-426b-bedc-6601defed41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:56.515950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-915d8963-2416-4649-90f3-cc50d6ffc9bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:56.516555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-915d8963-2416-4649-90f3-cc50d6ffc9bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:56.523767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-915d8963-2416-4649-90f3-cc50d6ffc9bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:56.524211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-915d8963-2416-4649-90f3-cc50d6ffc9bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:56.524994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-915d8963-2416-4649-90f3-cc50d6ffc9bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:56.525453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-915d8963-2416-4649-90f3-cc50d6ffc9bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:56.587060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e24c01ed-d278-426b-bedc-6601defed41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:56.594998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e24c01ed-d278-426b-bedc-6601defed41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.165917 Jun 20 06:27:56.595569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 643/1276] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:56.603138 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-915d8963-2416-4649-90f3-cc50d6ffc9bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:56.610630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-915d8963-2416-4649-90f3-cc50d6ffc9bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.098454 Jun 20 06:27:56.611242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 634/1277] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:56 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:57.514310 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:27:57.514874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:27:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:27:57.612055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-17056c16-ce98-4b77-8e32-eee4311a67ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:57.612599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-17056c16-ce98-4b77-8e32-eee4311a67ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:57.619380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17056c16-ce98-4b77-8e32-eee4311a67ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:57.619827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17056c16-ce98-4b77-8e32-eee4311a67ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:57.622022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17056c16-ce98-4b77-8e32-eee4311a67ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:57.622022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-17056c16-ce98-4b77-8e32-eee4311a67ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:57.627492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-efd4dabb-ea3a-489b-bfa2-c576a81a3240 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:57.628108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-efd4dabb-ea3a-489b-bfa2-c576a81a3240 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:57.634710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efd4dabb-ea3a-489b-bfa2-c576a81a3240 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:57.635165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efd4dabb-ea3a-489b-bfa2-c576a81a3240 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:57.635941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efd4dabb-ea3a-489b-bfa2-c576a81a3240 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:57.636379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efd4dabb-ea3a-489b-bfa2-c576a81a3240 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:57.715099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-efd4dabb-ea3a-489b-bfa2-c576a81a3240 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:57.723198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-efd4dabb-ea3a-489b-bfa2-c576a81a3240 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.099558 Jun 20 06:27:57.723766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 635/1278] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:57 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:57.782582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-17056c16-ce98-4b77-8e32-eee4311a67ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:57.790710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-17056c16-ce98-4b77-8e32-eee4311a67ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.182697 Jun 20 06:27:57.791269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 644/1279] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:58.740530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5d0e30ec-eea5-4dcd-844e-ab9515b85ad6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:58.741192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5d0e30ec-eea5-4dcd-844e-ab9515b85ad6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:58.747762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d0e30ec-eea5-4dcd-844e-ab9515b85ad6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:58.748215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d0e30ec-eea5-4dcd-844e-ab9515b85ad6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:58.748982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d0e30ec-eea5-4dcd-844e-ab9515b85ad6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:58.749455 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5d0e30ec-eea5-4dcd-844e-ab9515b85ad6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:58.752053 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:58.807927 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e11fe20c-2536-4005-9494-60ad5ecab142 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:58.809029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e11fe20c-2536-4005-9494-60ad5ecab142 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:58.811127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5d0e30ec-eea5-4dcd-844e-ab9515b85ad6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:58.815383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e11fe20c-2536-4005-9494-60ad5ecab142 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:58.815835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e11fe20c-2536-4005-9494-60ad5ecab142 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:58.816608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e11fe20c-2536-4005-9494-60ad5ecab142 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:58.817045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e11fe20c-2536-4005-9494-60ad5ecab142 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:58.819002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5d0e30ec-eea5-4dcd-844e-ab9515b85ad6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082964 Jun 20 06:27:58.819573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 636/1280] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:58 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:58.948742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e11fe20c-2536-4005-9494-60ad5ecab142 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:58.956750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e11fe20c-2536-4005-9494-60ad5ecab142 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152673 Jun 20 06:27:58.957307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 645/1281] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:59.754676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:27:59.755232 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:27:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:27:59.834756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3b827f0b-23c1-4e1b-ac2f-81e2c541b2b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:59.835366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3b827f0b-23c1-4e1b-ac2f-81e2c541b2b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:59.842013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b827f0b-23c1-4e1b-ac2f-81e2c541b2b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:59.842461 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b827f0b-23c1-4e1b-ac2f-81e2c541b2b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:59.843218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b827f0b-23c1-4e1b-ac2f-81e2c541b2b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:59.843652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b827f0b-23c1-4e1b-ac2f-81e2c541b2b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:59.905438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b827f0b-23c1-4e1b-ac2f-81e2c541b2b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:59.913288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3b827f0b-23c1-4e1b-ac2f-81e2c541b2b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082311 Jun 20 06:27:59.913888 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 637/1282] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:59 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:59.979247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c1224a9e-110d-4e6a-aab8-17a9dbe49c0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:59.979857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c1224a9e-110d-4e6a-aab8-17a9dbe49c0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:59.987582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1224a9e-110d-4e6a-aab8-17a9dbe49c0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:59.988008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1224a9e-110d-4e6a-aab8-17a9dbe49c0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:59.988772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1224a9e-110d-4e6a-aab8-17a9dbe49c0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:59.989203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1224a9e-110d-4e6a-aab8-17a9dbe49c0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:00.072072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:28:00.076836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:28:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 (ip 10.222.0.16) !!! Jun 20 06:28:00.125252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c1224a9e-110d-4e6a-aab8-17a9dbe49c0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:00.132816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c1224a9e-110d-4e6a-aab8-17a9dbe49c0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157360 Jun 20 06:28:00.133369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 646/1283] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:00.930164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2450db34-1be1-40c9-b05b-efaf403aa998 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:00.930777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2450db34-1be1-40c9-b05b-efaf403aa998 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:00.937257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2450db34-1be1-40c9-b05b-efaf403aa998 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:00.937735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2450db34-1be1-40c9-b05b-efaf403aa998 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:00.938500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2450db34-1be1-40c9-b05b-efaf403aa998 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:00.939419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2450db34-1be1-40c9-b05b-efaf403aa998 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:00.999160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2450db34-1be1-40c9-b05b-efaf403aa998 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:01.007146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2450db34-1be1-40c9-b05b-efaf403aa998 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080905 Jun 20 06:28:01.007712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 638/1284] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:00 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:01.150352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-690dc0c2-f58e-4d01-95d9-3314c6c8415e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:01.150984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-690dc0c2-f58e-4d01-95d9-3314c6c8415e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:01.157417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-690dc0c2-f58e-4d01-95d9-3314c6c8415e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:01.158088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-690dc0c2-f58e-4d01-95d9-3314c6c8415e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:01.159181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-690dc0c2-f58e-4d01-95d9-3314c6c8415e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:01.159886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-690dc0c2-f58e-4d01-95d9-3314c6c8415e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:01.291683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-690dc0c2-f58e-4d01-95d9-3314c6c8415e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:01.299788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-690dc0c2-f58e-4d01-95d9-3314c6c8415e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153295 Jun 20 06:28:01.300339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 647/1285] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:02.024425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9bd83ce4-1bc8-4833-8acf-031ca0c800e1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:02.025036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9bd83ce4-1bc8-4833-8acf-031ca0c800e1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:02.031488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9bd83ce4-1bc8-4833-8acf-031ca0c800e1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:02.031938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9bd83ce4-1bc8-4833-8acf-031ca0c800e1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:02.032761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9bd83ce4-1bc8-4833-8acf-031ca0c800e1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:02.033777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9bd83ce4-1bc8-4833-8acf-031ca0c800e1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:02.094886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9bd83ce4-1bc8-4833-8acf-031ca0c800e1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:02.102833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9bd83ce4-1bc8-4833-8acf-031ca0c800e1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082358 Jun 20 06:28:02.103396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 639/1286] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:02 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:02.316570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f82960ff-911e-4321-8ff6-72154a71cb5f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:02.317083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f82960ff-911e-4321-8ff6-72154a71cb5f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:02.323480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f82960ff-911e-4321-8ff6-72154a71cb5f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:02.323926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f82960ff-911e-4321-8ff6-72154a71cb5f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:02.324682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f82960ff-911e-4321-8ff6-72154a71cb5f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:02.325110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f82960ff-911e-4321-8ff6-72154a71cb5f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:02.453069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f82960ff-911e-4321-8ff6-72154a71cb5f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:02.461535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f82960ff-911e-4321-8ff6-72154a71cb5f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149410 Jun 20 06:28:02.462097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 648/1287] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:03.119516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-04373ad6-b50d-4558-8ace-4afd520fbe12 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:03.120130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-04373ad6-b50d-4558-8ace-4afd520fbe12 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:03.126641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04373ad6-b50d-4558-8ace-4afd520fbe12 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:03.127082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04373ad6-b50d-4558-8ace-4afd520fbe12 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:03.127844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04373ad6-b50d-4558-8ace-4afd520fbe12 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:03.128287 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04373ad6-b50d-4558-8ace-4afd520fbe12 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:03.190040 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-04373ad6-b50d-4558-8ace-4afd520fbe12 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:03.197474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-04373ad6-b50d-4558-8ace-4afd520fbe12 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081808 Jun 20 06:28:03.198064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 640/1288] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:03 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:03.478314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f458a16e-1703-42f0-aa9d-07baf055252a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:03.478924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f458a16e-1703-42f0-aa9d-07baf055252a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:03.485144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f458a16e-1703-42f0-aa9d-07baf055252a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:03.485694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f458a16e-1703-42f0-aa9d-07baf055252a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:03.486727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f458a16e-1703-42f0-aa9d-07baf055252a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:03.487157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f458a16e-1703-42f0-aa9d-07baf055252a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:03.627442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f458a16e-1703-42f0-aa9d-07baf055252a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:03.634808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f458a16e-1703-42f0-aa9d-07baf055252a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.160284 Jun 20 06:28:03.635368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 649/1289] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:28:04.214449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c51956fd-ed10-4b4e-89df-beb9147a305f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:04.215052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c51956fd-ed10-4b4e-89df-beb9147a305f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:04.221710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c51956fd-ed10-4b4e-89df-beb9147a305f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:04.222203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c51956fd-ed10-4b4e-89df-beb9147a305f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:04.223104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c51956fd-ed10-4b4e-89df-beb9147a305f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:04.223576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c51956fd-ed10-4b4e-89df-beb9147a305f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:04.286319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c51956fd-ed10-4b4e-89df-beb9147a305f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:04.293809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c51956fd-ed10-4b4e-89df-beb9147a305f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083142 Jun 20 06:28:04.294375 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 641/1290] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:04 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:04.654365 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a64d4bdd-3548-4dd8-956f-8fb003f1866c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:04.654971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a64d4bdd-3548-4dd8-956f-8fb003f1866c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:04.664549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a64d4bdd-3548-4dd8-956f-8fb003f1866c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:04.664990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a64d4bdd-3548-4dd8-956f-8fb003f1866c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:04.665781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a64d4bdd-3548-4dd8-956f-8fb003f1866c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:04.666212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a64d4bdd-3548-4dd8-956f-8fb003f1866c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:04.796644 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a64d4bdd-3548-4dd8-956f-8fb003f1866c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:04.805724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a64d4bdd-3548-4dd8-956f-8fb003f1866c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156318 Jun 20 06:28:04.806287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 650/1291] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:05.310860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff53ca5a-c2ae-4d21-9b69-5e48e90b4af4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:05.311516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff53ca5a-c2ae-4d21-9b69-5e48e90b4af4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:05.318179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff53ca5a-c2ae-4d21-9b69-5e48e90b4af4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:05.318633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff53ca5a-c2ae-4d21-9b69-5e48e90b4af4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:05.319411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff53ca5a-c2ae-4d21-9b69-5e48e90b4af4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:05.319851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff53ca5a-c2ae-4d21-9b69-5e48e90b4af4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:05.381195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff53ca5a-c2ae-4d21-9b69-5e48e90b4af4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:05.388652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff53ca5a-c2ae-4d21-9b69-5e48e90b4af4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081655 Jun 20 06:28:05.389211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 642/1292] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:05 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:05.823116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0ce2f6e1-5c02-4676-81ea-8df1ea458761 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:05.823722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0ce2f6e1-5c02-4676-81ea-8df1ea458761 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:05.830783 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ce2f6e1-5c02-4676-81ea-8df1ea458761 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:05.831225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ce2f6e1-5c02-4676-81ea-8df1ea458761 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:05.831978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ce2f6e1-5c02-4676-81ea-8df1ea458761 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:05.832415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ce2f6e1-5c02-4676-81ea-8df1ea458761 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:05.958947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0ce2f6e1-5c02-4676-81ea-8df1ea458761 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:05.966379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0ce2f6e1-5c02-4676-81ea-8df1ea458761 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147132 Jun 20 06:28:05.966930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 651/1293] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:06.405644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e56cafe3-e4ed-4a3b-bac3-4c4870198fc6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:06.406324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e56cafe3-e4ed-4a3b-bac3-4c4870198fc6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:06.412747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e56cafe3-e4ed-4a3b-bac3-4c4870198fc6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:06.413190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e56cafe3-e4ed-4a3b-bac3-4c4870198fc6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:06.413979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e56cafe3-e4ed-4a3b-bac3-4c4870198fc6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:06.414411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e56cafe3-e4ed-4a3b-bac3-4c4870198fc6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:06.474235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e56cafe3-e4ed-4a3b-bac3-4c4870198fc6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:06.481659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e56cafe3-e4ed-4a3b-bac3-4c4870198fc6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.079763 Jun 20 06:28:06.482432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 643/1294] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:06 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:06.983999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ee9f0944-5fb6-4d29-890e-fc6ba70bff48 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:06.984602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ee9f0944-5fb6-4d29-890e-fc6ba70bff48 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:06.992331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee9f0944-5fb6-4d29-890e-fc6ba70bff48 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:06.992777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee9f0944-5fb6-4d29-890e-fc6ba70bff48 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:06.993605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee9f0944-5fb6-4d29-890e-fc6ba70bff48 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:06.994038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee9f0944-5fb6-4d29-890e-fc6ba70bff48 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:07.125537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ee9f0944-5fb6-4d29-890e-fc6ba70bff48 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:07.133426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ee9f0944-5fb6-4d29-890e-fc6ba70bff48 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153286 Jun 20 06:28:07.133996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 652/1295] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:07.498356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0af7a2b9-af86-452e-8ea3-22b8c621eff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:07.498963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0af7a2b9-af86-452e-8ea3-22b8c621eff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:07.505403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0af7a2b9-af86-452e-8ea3-22b8c621eff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:07.505866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0af7a2b9-af86-452e-8ea3-22b8c621eff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:07.506619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0af7a2b9-af86-452e-8ea3-22b8c621eff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:07.507051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0af7a2b9-af86-452e-8ea3-22b8c621eff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:07.567646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0af7a2b9-af86-452e-8ea3-22b8c621eff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:07.574998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0af7a2b9-af86-452e-8ea3-22b8c621eff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080483 Jun 20 06:28:07.575552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 644/1296] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:07 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:08.151726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7e570acf-5b69-4d72-8468-e74fa91afa2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:08.152338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7e570acf-5b69-4d72-8468-e74fa91afa2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:08.158883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e570acf-5b69-4d72-8468-e74fa91afa2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:08.159323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e570acf-5b69-4d72-8468-e74fa91afa2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:08.160080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e570acf-5b69-4d72-8468-e74fa91afa2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:08.160515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e570acf-5b69-4d72-8468-e74fa91afa2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:08.292104 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7e570acf-5b69-4d72-8468-e74fa91afa2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:08.302950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7e570acf-5b69-4d72-8468-e74fa91afa2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.155075 Jun 20 06:28:08.303565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 653/1297] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:08.591945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-abae39b5-8fd9-49ed-ad73-682b8557f994 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:08.592543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-abae39b5-8fd9-49ed-ad73-682b8557f994 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:08.599773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abae39b5-8fd9-49ed-ad73-682b8557f994 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:08.600230 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abae39b5-8fd9-49ed-ad73-682b8557f994 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:08.600997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abae39b5-8fd9-49ed-ad73-682b8557f994 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:08.601470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abae39b5-8fd9-49ed-ad73-682b8557f994 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:08.668439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-abae39b5-8fd9-49ed-ad73-682b8557f994 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:08.676607 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-abae39b5-8fd9-49ed-ad73-682b8557f994 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.088450 Jun 20 06:28:08.677180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 645/1298] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:08 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:09.320980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dcfd31f0-1304-4d7f-bb35-59a16c7cf7ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:09.321649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dcfd31f0-1304-4d7f-bb35-59a16c7cf7ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:09.328353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dcfd31f0-1304-4d7f-bb35-59a16c7cf7ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:09.328801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dcfd31f0-1304-4d7f-bb35-59a16c7cf7ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:09.330367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dcfd31f0-1304-4d7f-bb35-59a16c7cf7ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:09.331023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dcfd31f0-1304-4d7f-bb35-59a16c7cf7ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:09.345740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:09.461857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dcfd31f0-1304-4d7f-bb35-59a16c7cf7ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:09.469168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dcfd31f0-1304-4d7f-bb35-59a16c7cf7ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152116 Jun 20 06:28:09.469759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 654/1299] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:09.693825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-27069e67-3fe6-4dcb-8033-01da1c307bd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:09.694441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-27069e67-3fe6-4dcb-8033-01da1c307bd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:09.700963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27069e67-3fe6-4dcb-8033-01da1c307bd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:09.701481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27069e67-3fe6-4dcb-8033-01da1c307bd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:09.702252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27069e67-3fe6-4dcb-8033-01da1c307bd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:09.702694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27069e67-3fe6-4dcb-8033-01da1c307bd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:09.762734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-27069e67-3fe6-4dcb-8033-01da1c307bd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:09.770574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-27069e67-3fe6-4dcb-8033-01da1c307bd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080668 Jun 20 06:28:09.771149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 646/1300] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:09 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:10.486945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e0401eb0-46d7-4b6f-9db9-769a2731119a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:10.487547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e0401eb0-46d7-4b6f-9db9-769a2731119a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:10.494071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0401eb0-46d7-4b6f-9db9-769a2731119a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:10.494514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0401eb0-46d7-4b6f-9db9-769a2731119a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:10.495283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0401eb0-46d7-4b6f-9db9-769a2731119a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:10.495695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0401eb0-46d7-4b6f-9db9-769a2731119a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:10.628476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e0401eb0-46d7-4b6f-9db9-769a2731119a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:10.635867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e0401eb0-46d7-4b6f-9db9-769a2731119a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153386 Jun 20 06:28:10.636425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 655/1301] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:10 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:10.787558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-94efc1cf-1596-4407-b62c-520c19776bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:10.788168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-94efc1cf-1596-4407-b62c-520c19776bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:10.794817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94efc1cf-1596-4407-b62c-520c19776bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:10.795265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94efc1cf-1596-4407-b62c-520c19776bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:10.796025 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94efc1cf-1596-4407-b62c-520c19776bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:10.796472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94efc1cf-1596-4407-b62c-520c19776bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:10.858520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94efc1cf-1596-4407-b62c-520c19776bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:10.866957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-94efc1cf-1596-4407-b62c-520c19776bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083232 Jun 20 06:28:10.867527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 647/1302] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:10 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:11.652429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0e7bf83c-37c9-4ac9-b303-b862e1f8a133 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:11.653036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0e7bf83c-37c9-4ac9-b303-b862e1f8a133 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:11.655346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:11.661047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0e7bf83c-37c9-4ac9-b303-b862e1f8a133 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:11.661520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0e7bf83c-37c9-4ac9-b303-b862e1f8a133 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:11.662306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0e7bf83c-37c9-4ac9-b303-b862e1f8a133 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:11.662732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0e7bf83c-37c9-4ac9-b303-b862e1f8a133 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:11.794596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0e7bf83c-37c9-4ac9-b303-b862e1f8a133 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:11.802641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0e7bf83c-37c9-4ac9-b303-b862e1f8a133 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154034 Jun 20 06:28:11.803209 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 656/1303] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:11.883428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1bf6c4a2-b884-437a-94e5-95526a71905a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:11.884031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1bf6c4a2-b884-437a-94e5-95526a71905a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:11.890365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf6c4a2-b884-437a-94e5-95526a71905a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:11.890809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf6c4a2-b884-437a-94e5-95526a71905a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:11.891850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf6c4a2-b884-437a-94e5-95526a71905a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:11.892475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf6c4a2-b884-437a-94e5-95526a71905a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:11.951556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1bf6c4a2-b884-437a-94e5-95526a71905a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:11.959030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1bf6c4a2-b884-437a-94e5-95526a71905a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.079364 Jun 20 06:28:11.959597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 648/1304] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:11 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:12.819962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-52b475e0-6ef7-424a-9591-774848108a6a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:12.820553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-52b475e0-6ef7-424a-9591-774848108a6a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:12.826953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b475e0-6ef7-424a-9591-774848108a6a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:12.827602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b475e0-6ef7-424a-9591-774848108a6a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:12.828138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b475e0-6ef7-424a-9591-774848108a6a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:12.828564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b475e0-6ef7-424a-9591-774848108a6a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:12.960447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-52b475e0-6ef7-424a-9591-774848108a6a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:12.967868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-52b475e0-6ef7-424a-9591-774848108a6a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151741 Jun 20 06:28:12.968423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 657/1305] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:12.975670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-71479c19-aa01-4ecf-aa39-b54f84426997 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:12.976284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-71479c19-aa01-4ecf-aa39-b54f84426997 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:12.982660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71479c19-aa01-4ecf-aa39-b54f84426997 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:12.983108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71479c19-aa01-4ecf-aa39-b54f84426997 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:12.983897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71479c19-aa01-4ecf-aa39-b54f84426997 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:12.984354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71479c19-aa01-4ecf-aa39-b54f84426997 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:13.051879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-71479c19-aa01-4ecf-aa39-b54f84426997 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:13.059379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-71479c19-aa01-4ecf-aa39-b54f84426997 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087518 Jun 20 06:28:13.059975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 649/1306] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:12 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:13.983975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ec794792-e75a-4a81-8c21-ae91f9611f8d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:13.984581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ec794792-e75a-4a81-8c21-ae91f9611f8d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:13.991593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec794792-e75a-4a81-8c21-ae91f9611f8d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:13.992044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec794792-e75a-4a81-8c21-ae91f9611f8d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:13.992810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec794792-e75a-4a81-8c21-ae91f9611f8d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:13.993243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec794792-e75a-4a81-8c21-ae91f9611f8d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:14.076125 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-12f7f0cf-3a22-4157-83bb-33948b8ca11f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:14.076732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-12f7f0cf-3a22-4157-83bb-33948b8ca11f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:14.079770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:14.085286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f7f0cf-3a22-4157-83bb-33948b8ca11f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:14.085759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f7f0cf-3a22-4157-83bb-33948b8ca11f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:14.086523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f7f0cf-3a22-4157-83bb-33948b8ca11f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:14.086957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f7f0cf-3a22-4157-83bb-33948b8ca11f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:14.134925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ec794792-e75a-4a81-8c21-ae91f9611f8d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:14.143332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ec794792-e75a-4a81-8c21-ae91f9611f8d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.163153 Jun 20 06:28:14.143902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 658/1307] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:14.151341 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-12f7f0cf-3a22-4157-83bb-33948b8ca11f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:14.159363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-12f7f0cf-3a22-4157-83bb-33948b8ca11f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087156 Jun 20 06:28:14.159920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 650/1308] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:14 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:15.160718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-86667055-6b2e-4edf-92ba-67c9260ed38a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:15.161355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-86667055-6b2e-4edf-92ba-67c9260ed38a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:15.167883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86667055-6b2e-4edf-92ba-67c9260ed38a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:15.168326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86667055-6b2e-4edf-92ba-67c9260ed38a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:15.169085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86667055-6b2e-4edf-92ba-67c9260ed38a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:15.169562 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86667055-6b2e-4edf-92ba-67c9260ed38a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:15.176508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eb7a6281-792b-46eb-ae40-95cfc1945b62 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:15.177116 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eb7a6281-792b-46eb-ae40-95cfc1945b62 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:15.183010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb7a6281-792b-46eb-ae40-95cfc1945b62 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:15.183457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb7a6281-792b-46eb-ae40-95cfc1945b62 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:15.184210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb7a6281-792b-46eb-ae40-95cfc1945b62 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:15.184640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb7a6281-792b-46eb-ae40-95cfc1945b62 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:15.267585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eb7a6281-792b-46eb-ae40-95cfc1945b62 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:15.275038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eb7a6281-792b-46eb-ae40-95cfc1945b62 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.103026 Jun 20 06:28:15.275599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 651/1309] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:15 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:28:15.323990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-86667055-6b2e-4edf-92ba-67c9260ed38a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:15.331553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-86667055-6b2e-4edf-92ba-67c9260ed38a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.175406 Jun 20 06:28:15.332143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 659/1310] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:15 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:16.291969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-15a77016-13db-42ca-abab-8a2b2e4a55cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:16.292576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-15a77016-13db-42ca-abab-8a2b2e4a55cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:16.299128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a77016-13db-42ca-abab-8a2b2e4a55cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:16.299568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a77016-13db-42ca-abab-8a2b2e4a55cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:16.300321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a77016-13db-42ca-abab-8a2b2e4a55cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:16.300753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15a77016-13db-42ca-abab-8a2b2e4a55cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:16.348670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b620bec1-f502-41cf-a9e2-fdafacea294e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:16.349279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b620bec1-f502-41cf-a9e2-fdafacea294e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:16.355761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b620bec1-f502-41cf-a9e2-fdafacea294e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:16.356210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b620bec1-f502-41cf-a9e2-fdafacea294e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:16.356965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b620bec1-f502-41cf-a9e2-fdafacea294e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:16.357411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b620bec1-f502-41cf-a9e2-fdafacea294e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:16.362758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-15a77016-13db-42ca-abab-8a2b2e4a55cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:16.364942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:16.371825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-15a77016-13db-42ca-abab-8a2b2e4a55cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083640 Jun 20 06:28:16.372407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 652/1311] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:16 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:16.487732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b620bec1-f502-41cf-a9e2-fdafacea294e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:16.495140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b620bec1-f502-41cf-a9e2-fdafacea294e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151107 Jun 20 06:28:16.495700 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 660/1312] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:17.388066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-12f13ddd-409f-4c7c-af7d-7f7ba0975e1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:17.388677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-12f13ddd-409f-4c7c-af7d-7f7ba0975e1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:17.395863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f13ddd-409f-4c7c-af7d-7f7ba0975e1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:17.396311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f13ddd-409f-4c7c-af7d-7f7ba0975e1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:17.397074 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f13ddd-409f-4c7c-af7d-7f7ba0975e1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:17.397549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f13ddd-409f-4c7c-af7d-7f7ba0975e1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:17.460495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-12f13ddd-409f-4c7c-af7d-7f7ba0975e1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:17.467874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-12f13ddd-409f-4c7c-af7d-7f7ba0975e1b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083732 Jun 20 06:28:17.468462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 653/1313] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:17 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:17.511940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-43527c08-1ce9-4a1c-bd7b-9c643ead2286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:17.512488 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-43527c08-1ce9-4a1c-bd7b-9c643ead2286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:17.519393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43527c08-1ce9-4a1c-bd7b-9c643ead2286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:17.519830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43527c08-1ce9-4a1c-bd7b-9c643ead2286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:17.520668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43527c08-1ce9-4a1c-bd7b-9c643ead2286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:17.521098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43527c08-1ce9-4a1c-bd7b-9c643ead2286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:17.647278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-43527c08-1ce9-4a1c-bd7b-9c643ead2286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:17.654918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-43527c08-1ce9-4a1c-bd7b-9c643ead2286 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.146834 Jun 20 06:28:17.655495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 661/1314] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:17 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:18.486538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac6455be-3d43-4c0d-bb86-7014f6104a15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:18.487157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ac6455be-3d43-4c0d-bb86-7014f6104a15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:18.493742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac6455be-3d43-4c0d-bb86-7014f6104a15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:18.494195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac6455be-3d43-4c0d-bb86-7014f6104a15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:18.494972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac6455be-3d43-4c0d-bb86-7014f6104a15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:18.495452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac6455be-3d43-4c0d-bb86-7014f6104a15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:18.558135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ac6455be-3d43-4c0d-bb86-7014f6104a15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:18.566623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ac6455be-3d43-4c0d-bb86-7014f6104a15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084625 Jun 20 06:28:18.567190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 654/1315] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:18 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:18.674372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e037773b-49e3-4814-8739-0979abb63edd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:18.675433 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e037773b-49e3-4814-8739-0979abb63edd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:18.682624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e037773b-49e3-4814-8739-0979abb63edd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:18.683070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e037773b-49e3-4814-8739-0979abb63edd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:18.683843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e037773b-49e3-4814-8739-0979abb63edd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:18.684301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e037773b-49e3-4814-8739-0979abb63edd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:18.838114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e037773b-49e3-4814-8739-0979abb63edd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:18.846432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e037773b-49e3-4814-8739-0979abb63edd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.177711 Jun 20 06:28:18.846998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 662/1316] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:19.583981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c304f8a4-c798-4e77-8f94-0cf9f2877241 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:19.584531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c304f8a4-c798-4e77-8f94-0cf9f2877241 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:19.590927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c304f8a4-c798-4e77-8f94-0cf9f2877241 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:19.591367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c304f8a4-c798-4e77-8f94-0cf9f2877241 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:19.592113 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c304f8a4-c798-4e77-8f94-0cf9f2877241 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:19.592542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c304f8a4-c798-4e77-8f94-0cf9f2877241 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:19.652935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c304f8a4-c798-4e77-8f94-0cf9f2877241 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:19.660415 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c304f8a4-c798-4e77-8f94-0cf9f2877241 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080324 Jun 20 06:28:19.660978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 655/1317] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:19 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:28:19.863885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c28d4b3b-73be-47e9-93bf-757a298580b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:19.864409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c28d4b3b-73be-47e9-93bf-757a298580b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:19.870849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c28d4b3b-73be-47e9-93bf-757a298580b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:19.871290 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c28d4b3b-73be-47e9-93bf-757a298580b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:19.872038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c28d4b3b-73be-47e9-93bf-757a298580b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:19.872466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c28d4b3b-73be-47e9-93bf-757a298580b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:20.002038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c28d4b3b-73be-47e9-93bf-757a298580b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:20.013984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c28d4b3b-73be-47e9-93bf-757a298580b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153996 Jun 20 06:28:20.014553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 663/1318] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:20.677056 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-98a4f06c-8e50-4466-adac-10ef8cbff7e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:20.677703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-98a4f06c-8e50-4466-adac-10ef8cbff7e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:20.684209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-98a4f06c-8e50-4466-adac-10ef8cbff7e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:20.684657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-98a4f06c-8e50-4466-adac-10ef8cbff7e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:20.685442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-98a4f06c-8e50-4466-adac-10ef8cbff7e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:20.685884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-98a4f06c-8e50-4466-adac-10ef8cbff7e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:20.748892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-98a4f06c-8e50-4466-adac-10ef8cbff7e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:20.756546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-98a4f06c-8e50-4466-adac-10ef8cbff7e6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083282 Jun 20 06:28:20.757119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 656/1319] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:20 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:21.031425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a1a3566f-704e-45ea-b953-64273c6a4368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:21.031980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a1a3566f-704e-45ea-b953-64273c6a4368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:21.039255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1a3566f-704e-45ea-b953-64273c6a4368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:21.039693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1a3566f-704e-45ea-b953-64273c6a4368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:21.040441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1a3566f-704e-45ea-b953-64273c6a4368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:21.040868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1a3566f-704e-45ea-b953-64273c6a4368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:21.170551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a1a3566f-704e-45ea-b953-64273c6a4368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:21.178086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a1a3566f-704e-45ea-b953-64273c6a4368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150559 Jun 20 06:28:21.178645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 664/1320] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:21.773250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-957a4615-0fcf-4d1d-9070-7ee3af5ad89e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:21.773972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-957a4615-0fcf-4d1d-9070-7ee3af5ad89e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:21.780507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-957a4615-0fcf-4d1d-9070-7ee3af5ad89e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:21.780960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-957a4615-0fcf-4d1d-9070-7ee3af5ad89e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:21.781748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-957a4615-0fcf-4d1d-9070-7ee3af5ad89e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:21.783293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-957a4615-0fcf-4d1d-9070-7ee3af5ad89e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:21.852684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-957a4615-0fcf-4d1d-9070-7ee3af5ad89e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:21.861459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-957a4615-0fcf-4d1d-9070-7ee3af5ad89e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.090862 Jun 20 06:28:21.862020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 657/1321] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:21 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:22.195443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-398a945f-5622-40c0-a4d6-d51a1403d389 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:22.196022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-398a945f-5622-40c0-a4d6-d51a1403d389 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:22.202409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-398a945f-5622-40c0-a4d6-d51a1403d389 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:22.202923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-398a945f-5622-40c0-a4d6-d51a1403d389 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:22.203727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-398a945f-5622-40c0-a4d6-d51a1403d389 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:22.204169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-398a945f-5622-40c0-a4d6-d51a1403d389 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:22.370085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-398a945f-5622-40c0-a4d6-d51a1403d389 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:22.377846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-398a945f-5622-40c0-a4d6-d51a1403d389 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.186308 Jun 20 06:28:22.378960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 665/1322] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:22 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:22.877862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c6f7a83-cf71-4db9-ba2f-7028f4229365 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:22.878473 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c6f7a83-cf71-4db9-ba2f-7028f4229365 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:22.884784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c6f7a83-cf71-4db9-ba2f-7028f4229365 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:22.885233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c6f7a83-cf71-4db9-ba2f-7028f4229365 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:22.886029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c6f7a83-cf71-4db9-ba2f-7028f4229365 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:22.886468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c6f7a83-cf71-4db9-ba2f-7028f4229365 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:22.947172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c6f7a83-cf71-4db9-ba2f-7028f4229365 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:22.955357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c6f7a83-cf71-4db9-ba2f-7028f4229365 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081625 Jun 20 06:28:22.955927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 658/1323] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:22 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:23.396726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3a910e75-6c1a-44a3-8fff-3a6ab7e9519e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:23.397367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3a910e75-6c1a-44a3-8fff-3a6ab7e9519e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:23.403838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a910e75-6c1a-44a3-8fff-3a6ab7e9519e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:23.404285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a910e75-6c1a-44a3-8fff-3a6ab7e9519e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:23.405036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a910e75-6c1a-44a3-8fff-3a6ab7e9519e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:23.405490 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a910e75-6c1a-44a3-8fff-3a6ab7e9519e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:23.534512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3a910e75-6c1a-44a3-8fff-3a6ab7e9519e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:23.541957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3a910e75-6c1a-44a3-8fff-3a6ab7e9519e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150092 Jun 20 06:28:23.542509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 666/1324] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:23.972141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3605e997-87d3-4181-8a7d-a845e2146545 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:23.972733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3605e997-87d3-4181-8a7d-a845e2146545 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:23.979348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3605e997-87d3-4181-8a7d-a845e2146545 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:23.979796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3605e997-87d3-4181-8a7d-a845e2146545 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:23.980552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3605e997-87d3-4181-8a7d-a845e2146545 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:23.980983 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3605e997-87d3-4181-8a7d-a845e2146545 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:24.045585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3605e997-87d3-4181-8a7d-a845e2146545 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:24.053777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3605e997-87d3-4181-8a7d-a845e2146545 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085630 Jun 20 06:28:24.054345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 659/1325] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:23 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:24.559094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cde351da-f350-4d52-b328-4dac337715d2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:24.559707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cde351da-f350-4d52-b328-4dac337715d2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:24.566222 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cde351da-f350-4d52-b328-4dac337715d2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:24.566670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cde351da-f350-4d52-b328-4dac337715d2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:24.567426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cde351da-f350-4d52-b328-4dac337715d2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:24.567862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cde351da-f350-4d52-b328-4dac337715d2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:24.695578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cde351da-f350-4d52-b328-4dac337715d2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:24.703072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cde351da-f350-4d52-b328-4dac337715d2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147839 Jun 20 06:28:24.703638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 667/1326] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:24 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:25.070202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f6d20a7-9db8-4bff-a815-4caa23288920 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:25.070735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f6d20a7-9db8-4bff-a815-4caa23288920 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:25.077236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f6d20a7-9db8-4bff-a815-4caa23288920 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:25.077719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f6d20a7-9db8-4bff-a815-4caa23288920 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:25.078469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f6d20a7-9db8-4bff-a815-4caa23288920 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:25.079559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f6d20a7-9db8-4bff-a815-4caa23288920 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:25.142362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f6d20a7-9db8-4bff-a815-4caa23288920 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:25.149899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f6d20a7-9db8-4bff-a815-4caa23288920 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083625 Jun 20 06:28:25.150462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 660/1327] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:25 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:25.720845 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3a028c83-d18f-4835-88cf-b061440239dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:25.721530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3a028c83-d18f-4835-88cf-b061440239dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:25.728088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a028c83-d18f-4835-88cf-b061440239dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:25.728533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a028c83-d18f-4835-88cf-b061440239dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:25.729289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a028c83-d18f-4835-88cf-b061440239dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:25.729753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a028c83-d18f-4835-88cf-b061440239dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:25.856747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3a028c83-d18f-4835-88cf-b061440239dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:25.864491 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3a028c83-d18f-4835-88cf-b061440239dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148006 Jun 20 06:28:25.865055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 668/1328] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:25 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:26.167073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b769055-804e-4e0c-a630-04fa21802c59 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:26.167684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2b769055-804e-4e0c-a630-04fa21802c59 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:26.174797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b769055-804e-4e0c-a630-04fa21802c59 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:26.175246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b769055-804e-4e0c-a630-04fa21802c59 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:26.176005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b769055-804e-4e0c-a630-04fa21802c59 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:26.176440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b769055-804e-4e0c-a630-04fa21802c59 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:26.237911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b769055-804e-4e0c-a630-04fa21802c59 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:26.245225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2b769055-804e-4e0c-a630-04fa21802c59 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082042 Jun 20 06:28:26.245829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 661/1329] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:26 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:26.881922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a9592b90-1ece-4aed-8fbf-803e55dd0300 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:26.882542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a9592b90-1ece-4aed-8fbf-803e55dd0300 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:26.888947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a9592b90-1ece-4aed-8fbf-803e55dd0300 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:26.889401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a9592b90-1ece-4aed-8fbf-803e55dd0300 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:26.890179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a9592b90-1ece-4aed-8fbf-803e55dd0300 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:26.890611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a9592b90-1ece-4aed-8fbf-803e55dd0300 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:27.029194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a9592b90-1ece-4aed-8fbf-803e55dd0300 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:27.037334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a9592b90-1ece-4aed-8fbf-803e55dd0300 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.159293 Jun 20 06:28:27.037933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 669/1330] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:27.262845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6292e0f9-6774-493e-aacd-f59a8deb81aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:27.263391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6292e0f9-6774-493e-aacd-f59a8deb81aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:27.273045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6292e0f9-6774-493e-aacd-f59a8deb81aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:27.273527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6292e0f9-6774-493e-aacd-f59a8deb81aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:27.274299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6292e0f9-6774-493e-aacd-f59a8deb81aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:27.274736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6292e0f9-6774-493e-aacd-f59a8deb81aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:27.335867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6292e0f9-6774-493e-aacd-f59a8deb81aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:27.343393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6292e0f9-6774-493e-aacd-f59a8deb81aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084428 Jun 20 06:28:27.343956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 662/1331] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:27 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:28.054784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f5ff2aad-8ee2-4000-a189-72efb1f2b12c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:28.055327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f5ff2aad-8ee2-4000-a189-72efb1f2b12c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:28.062054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5ff2aad-8ee2-4000-a189-72efb1f2b12c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:28.062502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5ff2aad-8ee2-4000-a189-72efb1f2b12c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:28.063295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5ff2aad-8ee2-4000-a189-72efb1f2b12c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:28.063731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5ff2aad-8ee2-4000-a189-72efb1f2b12c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:28.191800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f5ff2aad-8ee2-4000-a189-72efb1f2b12c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:28.199148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f5ff2aad-8ee2-4000-a189-72efb1f2b12c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148309 Jun 20 06:28:28.199709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 670/1332] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:28 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:28.359956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-71385bcf-e072-4a3a-93cf-99fdd81c47f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:28.360593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-71385bcf-e072-4a3a-93cf-99fdd81c47f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:28.367018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71385bcf-e072-4a3a-93cf-99fdd81c47f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:28.367463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71385bcf-e072-4a3a-93cf-99fdd81c47f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:28.368215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71385bcf-e072-4a3a-93cf-99fdd81c47f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:28.368648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71385bcf-e072-4a3a-93cf-99fdd81c47f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:28.433587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-71385bcf-e072-4a3a-93cf-99fdd81c47f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:28.441766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-71385bcf-e072-4a3a-93cf-99fdd81c47f6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085660 Jun 20 06:28:28.442329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 663/1333] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:28 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:29.215964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bd0e6f73-3538-4bd3-a9ba-673756d4baad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:29.216608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bd0e6f73-3538-4bd3-a9ba-673756d4baad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:29.223149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd0e6f73-3538-4bd3-a9ba-673756d4baad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:29.223597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd0e6f73-3538-4bd3-a9ba-673756d4baad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:29.224355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd0e6f73-3538-4bd3-a9ba-673756d4baad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:29.224786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd0e6f73-3538-4bd3-a9ba-673756d4baad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:29.227292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:29.457992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8f3e000-b642-41fe-851f-7f4a5e2e0078 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:29.458607 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8f3e000-b642-41fe-851f-7f4a5e2e0078 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:29.465226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8f3e000-b642-41fe-851f-7f4a5e2e0078 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:29.465846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8f3e000-b642-41fe-851f-7f4a5e2e0078 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:29.466554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8f3e000-b642-41fe-851f-7f4a5e2e0078 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:29.466935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8f3e000-b642-41fe-851f-7f4a5e2e0078 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:29.566791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8f3e000-b642-41fe-851f-7f4a5e2e0078 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:29.574381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8f3e000-b642-41fe-851f-7f4a5e2e0078 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.120743 Jun 20 06:28:29.574951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 664/1334] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:29 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:28:29.614270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bd0e6f73-3538-4bd3-a9ba-673756d4baad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:29.621828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bd0e6f73-3538-4bd3-a9ba-673756d4baad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.409710 Jun 20 06:28:29.622384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 671/1335] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:30.591352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f700475-091f-4d7c-bddd-4537d206db32 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:30.591885 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f700475-091f-4d7c-bddd-4537d206db32 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:30.598879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f700475-091f-4d7c-bddd-4537d206db32 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:30.599319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f700475-091f-4d7c-bddd-4537d206db32 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:30.600067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f700475-091f-4d7c-bddd-4537d206db32 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:30.600497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f700475-091f-4d7c-bddd-4537d206db32 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:30.638858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-743b84fc-893c-4a9b-b099-6ecc0addce78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:30.639469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-743b84fc-893c-4a9b-b099-6ecc0addce78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:30.646807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-743b84fc-893c-4a9b-b099-6ecc0addce78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:30.647273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-743b84fc-893c-4a9b-b099-6ecc0addce78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:30.648027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-743b84fc-893c-4a9b-b099-6ecc0addce78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:30.648451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-743b84fc-893c-4a9b-b099-6ecc0addce78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:30.663371 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f700475-091f-4d7c-bddd-4537d206db32 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:30.670946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f700475-091f-4d7c-bddd-4537d206db32 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083608 Jun 20 06:28:30.671742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 665/1336] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:30 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:30.777812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-743b84fc-893c-4a9b-b099-6ecc0addce78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:30.786224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-743b84fc-893c-4a9b-b099-6ecc0addce78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151093 Jun 20 06:28:30.786798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 672/1337] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:28:31.687843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-72995091-d3de-464d-ae4d-97d99479d74f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:31.688642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-72995091-d3de-464d-ae4d-97d99479d74f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:31.695077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72995091-d3de-464d-ae4d-97d99479d74f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:31.695531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72995091-d3de-464d-ae4d-97d99479d74f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:31.696297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72995091-d3de-464d-ae4d-97d99479d74f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:31.696740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-72995091-d3de-464d-ae4d-97d99479d74f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:31.756596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-72995091-d3de-464d-ae4d-97d99479d74f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:31.764008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-72995091-d3de-464d-ae4d-97d99479d74f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080042 Jun 20 06:28:31.764575 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 666/1338] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:31 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:31.803820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-90aa621d-284a-44b9-bcba-40b201a95312 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:31.804422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-90aa621d-284a-44b9-bcba-40b201a95312 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:31.810752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90aa621d-284a-44b9-bcba-40b201a95312 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:31.811193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90aa621d-284a-44b9-bcba-40b201a95312 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:31.811942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90aa621d-284a-44b9-bcba-40b201a95312 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:31.812369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90aa621d-284a-44b9-bcba-40b201a95312 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:31.944275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-90aa621d-284a-44b9-bcba-40b201a95312 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:31.951637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-90aa621d-284a-44b9-bcba-40b201a95312 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151578 Jun 20 06:28:31.952193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 673/1339] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:31 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:32.780651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e014e73-7ab3-4de0-9235-3725da0689ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:32.781260 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5e014e73-7ab3-4de0-9235-3725da0689ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:32.788045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e014e73-7ab3-4de0-9235-3725da0689ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:32.788489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e014e73-7ab3-4de0-9235-3725da0689ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:32.789272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e014e73-7ab3-4de0-9235-3725da0689ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:32.789738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e014e73-7ab3-4de0-9235-3725da0689ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:32.854199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e014e73-7ab3-4de0-9235-3725da0689ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:32.862121 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e014e73-7ab3-4de0-9235-3725da0689ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085298 Jun 20 06:28:32.862677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 667/1340] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:32 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:32.969572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c6cd586f-b003-481d-9e79-0e8e912b3759 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:32.970183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c6cd586f-b003-481d-9e79-0e8e912b3759 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:32.976324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6cd586f-b003-481d-9e79-0e8e912b3759 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:32.976769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6cd586f-b003-481d-9e79-0e8e912b3759 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:32.977567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6cd586f-b003-481d-9e79-0e8e912b3759 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:32.978008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6cd586f-b003-481d-9e79-0e8e912b3759 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:33.107083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c6cd586f-b003-481d-9e79-0e8e912b3759 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:33.115149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c6cd586f-b003-481d-9e79-0e8e912b3759 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149499 Jun 20 06:28:33.115715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 674/1341] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:32 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:33.879787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b5ed4b2d-db49-46e6-9c76-b31a994990b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:33.880424 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b5ed4b2d-db49-46e6-9c76-b31a994990b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:33.887086 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5ed4b2d-db49-46e6-9c76-b31a994990b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:33.887535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5ed4b2d-db49-46e6-9c76-b31a994990b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:33.888313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5ed4b2d-db49-46e6-9c76-b31a994990b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:33.888737 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5ed4b2d-db49-46e6-9c76-b31a994990b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:33.950977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b5ed4b2d-db49-46e6-9c76-b31a994990b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:33.959197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b5ed4b2d-db49-46e6-9c76-b31a994990b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083836 Jun 20 06:28:33.959756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 668/1342] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:33 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:34.132504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7a3b0e71-8347-47df-8e15-7256ce3f77ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:34.133044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7a3b0e71-8347-47df-8e15-7256ce3f77ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:34.139434 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a3b0e71-8347-47df-8e15-7256ce3f77ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:34.139877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a3b0e71-8347-47df-8e15-7256ce3f77ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:34.140624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a3b0e71-8347-47df-8e15-7256ce3f77ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:34.142036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a3b0e71-8347-47df-8e15-7256ce3f77ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:34.268629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7a3b0e71-8347-47df-8e15-7256ce3f77ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:34.276080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7a3b0e71-8347-47df-8e15-7256ce3f77ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147506 Jun 20 06:28:34.276631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 675/1343] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:34.975829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0dc36022-89ed-4c57-b9c8-3e8cadf467cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:34.976442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0dc36022-89ed-4c57-b9c8-3e8cadf467cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:34.982925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dc36022-89ed-4c57-b9c8-3e8cadf467cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:34.983373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dc36022-89ed-4c57-b9c8-3e8cadf467cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:34.984131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dc36022-89ed-4c57-b9c8-3e8cadf467cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:34.984582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0dc36022-89ed-4c57-b9c8-3e8cadf467cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:34.999599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:35.046329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0dc36022-89ed-4c57-b9c8-3e8cadf467cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:35.053788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0dc36022-89ed-4c57-b9c8-3e8cadf467cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081741 Jun 20 06:28:35.054299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 669/1344] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:34 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:35.293571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a6ee1a40-2205-49b9-b119-b4144da22773 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:35.294180 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a6ee1a40-2205-49b9-b119-b4144da22773 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:35.300975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a6ee1a40-2205-49b9-b119-b4144da22773 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:35.301438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a6ee1a40-2205-49b9-b119-b4144da22773 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:35.302183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a6ee1a40-2205-49b9-b119-b4144da22773 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:35.302640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a6ee1a40-2205-49b9-b119-b4144da22773 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:35.436769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a6ee1a40-2205-49b9-b119-b4144da22773 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:35.445408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a6ee1a40-2205-49b9-b119-b4144da22773 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.155985 Jun 20 06:28:35.445969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 676/1345] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:35 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:36.070282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1fd5a073-120b-4f0c-af54-14a5d114f69d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:36.070886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1fd5a073-120b-4f0c-af54-14a5d114f69d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:36.077575 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fd5a073-120b-4f0c-af54-14a5d114f69d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:36.078025 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fd5a073-120b-4f0c-af54-14a5d114f69d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:36.079332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fd5a073-120b-4f0c-af54-14a5d114f69d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:36.079777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fd5a073-120b-4f0c-af54-14a5d114f69d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:36.142392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1fd5a073-120b-4f0c-af54-14a5d114f69d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:36.149858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1fd5a073-120b-4f0c-af54-14a5d114f69d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083426 Jun 20 06:28:36.150417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 670/1346] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:36 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:36.463341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-06169331-568a-4531-bc01-6a06fe0c55c9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:36.463974 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-06169331-568a-4531-bc01-6a06fe0c55c9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:36.471525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06169331-568a-4531-bc01-6a06fe0c55c9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:36.471971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06169331-568a-4531-bc01-6a06fe0c55c9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:36.472730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06169331-568a-4531-bc01-6a06fe0c55c9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:36.473165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06169331-568a-4531-bc01-6a06fe0c55c9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:36.601207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-06169331-568a-4531-bc01-6a06fe0c55c9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:36.608887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-06169331-568a-4531-bc01-6a06fe0c55c9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149406 Jun 20 06:28:36.609479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 677/1347] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:37.167441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bb32d750-c965-4828-91af-69d386f3a6fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:37.168078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bb32d750-c965-4828-91af-69d386f3a6fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:37.174706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb32d750-c965-4828-91af-69d386f3a6fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:37.175148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb32d750-c965-4828-91af-69d386f3a6fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:37.175899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb32d750-c965-4828-91af-69d386f3a6fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:37.176333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb32d750-c965-4828-91af-69d386f3a6fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:37.239044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bb32d750-c965-4828-91af-69d386f3a6fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:37.246649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bb32d750-c965-4828-91af-69d386f3a6fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083015 Jun 20 06:28:37.247223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 671/1348] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:37 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:37.627586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1e5f2dca-92b7-4af9-8d48-d4fb1c93b241 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:37.628116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1e5f2dca-92b7-4af9-8d48-d4fb1c93b241 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:37.634617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e5f2dca-92b7-4af9-8d48-d4fb1c93b241 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:37.635068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e5f2dca-92b7-4af9-8d48-d4fb1c93b241 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:37.635834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e5f2dca-92b7-4af9-8d48-d4fb1c93b241 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:37.636272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e5f2dca-92b7-4af9-8d48-d4fb1c93b241 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:37.764149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1e5f2dca-92b7-4af9-8d48-d4fb1c93b241 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:37.773737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1e5f2dca-92b7-4af9-8d48-d4fb1c93b241 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150364 Jun 20 06:28:37.774315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 678/1349] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:38.263432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e81fa085-a685-4850-8d22-5fc658751f83 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:38.264032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e81fa085-a685-4850-8d22-5fc658751f83 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:38.271325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e81fa085-a685-4850-8d22-5fc658751f83 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:38.271843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e81fa085-a685-4850-8d22-5fc658751f83 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:38.272639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e81fa085-a685-4850-8d22-5fc658751f83 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:38.273072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e81fa085-a685-4850-8d22-5fc658751f83 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:38.334990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e81fa085-a685-4850-8d22-5fc658751f83 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:38.342472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e81fa085-a685-4850-8d22-5fc658751f83 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082896 Jun 20 06:28:38.343032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 672/1350] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:38 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:38.793863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38789e0f-0120-40ac-90e7-37b356c247dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:38.794476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-38789e0f-0120-40ac-90e7-37b356c247dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:38.801118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38789e0f-0120-40ac-90e7-37b356c247dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:38.801599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38789e0f-0120-40ac-90e7-37b356c247dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:38.802361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38789e0f-0120-40ac-90e7-37b356c247dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:38.802823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38789e0f-0120-40ac-90e7-37b356c247dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:38.934567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-38789e0f-0120-40ac-90e7-37b356c247dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:38.942019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-38789e0f-0120-40ac-90e7-37b356c247dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152033 Jun 20 06:28:38.942587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 679/1351] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:38 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:39.358756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d93843d-0c7c-4685-8d1e-270e3b27d820 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:39.359299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d93843d-0c7c-4685-8d1e-270e3b27d820 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:39.365754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d93843d-0c7c-4685-8d1e-270e3b27d820 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:39.366202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d93843d-0c7c-4685-8d1e-270e3b27d820 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:39.366957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d93843d-0c7c-4685-8d1e-270e3b27d820 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:39.367389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d93843d-0c7c-4685-8d1e-270e3b27d820 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:39.428878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d93843d-0c7c-4685-8d1e-270e3b27d820 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:39.436646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d93843d-0c7c-4685-8d1e-270e3b27d820 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081732 Jun 20 06:28:39.437208 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 673/1352] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:39 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:39.959746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5114a22f-df18-4fcc-ac7f-ae194cc90d1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:39.960348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5114a22f-df18-4fcc-ac7f-ae194cc90d1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:39.967468 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5114a22f-df18-4fcc-ac7f-ae194cc90d1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:39.967910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5114a22f-df18-4fcc-ac7f-ae194cc90d1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:39.968666 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5114a22f-df18-4fcc-ac7f-ae194cc90d1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:39.969789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5114a22f-df18-4fcc-ac7f-ae194cc90d1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:40.100818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5114a22f-df18-4fcc-ac7f-ae194cc90d1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:40.108266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5114a22f-df18-4fcc-ac7f-ae194cc90d1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152556 Jun 20 06:28:40.108832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 680/1353] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:39 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:40.454528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5079c1dc-7491-419f-9ba1-0f33505f95ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:40.455131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5079c1dc-7491-419f-9ba1-0f33505f95ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:40.461740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5079c1dc-7491-419f-9ba1-0f33505f95ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:40.462185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5079c1dc-7491-419f-9ba1-0f33505f95ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:40.462942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5079c1dc-7491-419f-9ba1-0f33505f95ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:40.463373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5079c1dc-7491-419f-9ba1-0f33505f95ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:40.530069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5079c1dc-7491-419f-9ba1-0f33505f95ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:40.538182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5079c1dc-7491-419f-9ba1-0f33505f95ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087963 Jun 20 06:28:40.538773 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 674/1354] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:40 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:41.126205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-adcd3732-a60c-4278-9fbc-9cfd74328a7b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:41.126854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-adcd3732-a60c-4278-9fbc-9cfd74328a7b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:41.133275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adcd3732-a60c-4278-9fbc-9cfd74328a7b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:41.133754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adcd3732-a60c-4278-9fbc-9cfd74328a7b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:41.134509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adcd3732-a60c-4278-9fbc-9cfd74328a7b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:41.134940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adcd3732-a60c-4278-9fbc-9cfd74328a7b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:41.261692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-adcd3732-a60c-4278-9fbc-9cfd74328a7b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:41.270000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-adcd3732-a60c-4278-9fbc-9cfd74328a7b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147725 Jun 20 06:28:41.270561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 681/1355] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:41.554789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dc72be96-d821-4f21-b177-53eab0927031 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:41.555423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dc72be96-d821-4f21-b177-53eab0927031 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:41.561921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc72be96-d821-4f21-b177-53eab0927031 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:41.562371 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc72be96-d821-4f21-b177-53eab0927031 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:41.564062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc72be96-d821-4f21-b177-53eab0927031 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:41.564497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc72be96-d821-4f21-b177-53eab0927031 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:41.624878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc72be96-d821-4f21-b177-53eab0927031 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:41.633306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dc72be96-d821-4f21-b177-53eab0927031 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082329 Jun 20 06:28:41.633974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 675/1356] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:41 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:42.287628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7972c863-e930-495c-ba24-0e2acb503bbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:42.288161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7972c863-e930-495c-ba24-0e2acb503bbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:42.290580 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:42.296540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7972c863-e930-495c-ba24-0e2acb503bbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:42.297021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7972c863-e930-495c-ba24-0e2acb503bbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:42.298343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7972c863-e930-495c-ba24-0e2acb503bbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:42.298775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7972c863-e930-495c-ba24-0e2acb503bbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:42.430317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7972c863-e930-495c-ba24-0e2acb503bbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:42.437718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7972c863-e930-495c-ba24-0e2acb503bbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153935 Jun 20 06:28:42.438380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 682/1357] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:42 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:42.651247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-186acc3c-1911-454d-8ecb-9985a68696cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:42.651858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-186acc3c-1911-454d-8ecb-9985a68696cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:42.659080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-186acc3c-1911-454d-8ecb-9985a68696cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:42.659531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-186acc3c-1911-454d-8ecb-9985a68696cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:42.660291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-186acc3c-1911-454d-8ecb-9985a68696cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:42.660728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-186acc3c-1911-454d-8ecb-9985a68696cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:42.721130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-186acc3c-1911-454d-8ecb-9985a68696cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:42.728671 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-186acc3c-1911-454d-8ecb-9985a68696cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081320 Jun 20 06:28:42.729240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 676/1358] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:42 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:43.454886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fad2c30f-291d-4a61-849a-4d356ef6a0b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:43.455511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fad2c30f-291d-4a61-849a-4d356ef6a0b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:43.461947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad2c30f-291d-4a61-849a-4d356ef6a0b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:43.462387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad2c30f-291d-4a61-849a-4d356ef6a0b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:43.463138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad2c30f-291d-4a61-849a-4d356ef6a0b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:43.463565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad2c30f-291d-4a61-849a-4d356ef6a0b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:43.591493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fad2c30f-291d-4a61-849a-4d356ef6a0b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:43.599666 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fad2c30f-291d-4a61-849a-4d356ef6a0b5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148648 Jun 20 06:28:43.600224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 683/1359] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:43.745087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-651a5cdf-cf73-4e88-833b-d859b9ad9bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:43.745717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-651a5cdf-cf73-4e88-833b-d859b9ad9bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:43.752293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-651a5cdf-cf73-4e88-833b-d859b9ad9bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:43.752735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-651a5cdf-cf73-4e88-833b-d859b9ad9bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:43.753509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-651a5cdf-cf73-4e88-833b-d859b9ad9bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:43.753941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-651a5cdf-cf73-4e88-833b-d859b9ad9bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:43.818941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-651a5cdf-cf73-4e88-833b-d859b9ad9bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:43.826495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-651a5cdf-cf73-4e88-833b-d859b9ad9bb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085197 Jun 20 06:28:43.827052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 677/1360] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:43 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:44.616080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4636ed93-f601-454f-8fe0-01c2010ccf23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:44.616630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4636ed93-f601-454f-8fe0-01c2010ccf23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:44.623163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4636ed93-f601-454f-8fe0-01c2010ccf23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:44.623595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4636ed93-f601-454f-8fe0-01c2010ccf23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:44.624361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4636ed93-f601-454f-8fe0-01c2010ccf23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:44.624798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4636ed93-f601-454f-8fe0-01c2010ccf23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:44.755233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4636ed93-f601-454f-8fe0-01c2010ccf23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:44.762717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4636ed93-f601-454f-8fe0-01c2010ccf23 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150637 Jun 20 06:28:44.763278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 684/1361] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:44.843205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f175efd-4458-45b5-b947-ee9e09834688 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:44.843856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f175efd-4458-45b5-b947-ee9e09834688 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:44.846001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:44.851295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f175efd-4458-45b5-b947-ee9e09834688 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:44.851754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f175efd-4458-45b5-b947-ee9e09834688 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:44.852519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f175efd-4458-45b5-b947-ee9e09834688 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:44.852962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f175efd-4458-45b5-b947-ee9e09834688 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:44.914511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f175efd-4458-45b5-b947-ee9e09834688 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:44.922648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f175efd-4458-45b5-b947-ee9e09834688 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082646 Jun 20 06:28:44.923392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 678/1362] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:44 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:45.780191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-92c21b3f-74ed-4e3e-bc7b-ebb3a125e8b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:45.780778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-92c21b3f-74ed-4e3e-bc7b-ebb3a125e8b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:45.788213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92c21b3f-74ed-4e3e-bc7b-ebb3a125e8b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:45.788658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92c21b3f-74ed-4e3e-bc7b-ebb3a125e8b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:45.789440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92c21b3f-74ed-4e3e-bc7b-ebb3a125e8b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:45.789999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92c21b3f-74ed-4e3e-bc7b-ebb3a125e8b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:45.920783 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-92c21b3f-74ed-4e3e-bc7b-ebb3a125e8b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:45.928884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-92c21b3f-74ed-4e3e-bc7b-ebb3a125e8b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152548 Jun 20 06:28:45.929452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 685/1363] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:45.939742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-539ed45c-42e9-487e-a70c-5e10ae064ffe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:45.940352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-539ed45c-42e9-487e-a70c-5e10ae064ffe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:45.946782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-539ed45c-42e9-487e-a70c-5e10ae064ffe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:45.947231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-539ed45c-42e9-487e-a70c-5e10ae064ffe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:45.947987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-539ed45c-42e9-487e-a70c-5e10ae064ffe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:45.948423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-539ed45c-42e9-487e-a70c-5e10ae064ffe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:46.009474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-539ed45c-42e9-487e-a70c-5e10ae064ffe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:46.017179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-539ed45c-42e9-487e-a70c-5e10ae064ffe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081748 Jun 20 06:28:46.017771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 679/1364] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:45 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:46.945863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-221dd9f6-7f98-45b1-adf2-ee0143df35d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:46.946475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-221dd9f6-7f98-45b1-adf2-ee0143df35d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:46.953276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-221dd9f6-7f98-45b1-adf2-ee0143df35d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:46.953771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-221dd9f6-7f98-45b1-adf2-ee0143df35d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:46.955293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-221dd9f6-7f98-45b1-adf2-ee0143df35d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:46.955891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-221dd9f6-7f98-45b1-adf2-ee0143df35d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:47.034992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3df9b892-3a7e-4984-a090-785c5ecdea8d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:47.035394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3df9b892-3a7e-4984-a090-785c5ecdea8d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:47.043039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3df9b892-3a7e-4984-a090-785c5ecdea8d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:47.043496 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3df9b892-3a7e-4984-a090-785c5ecdea8d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:47.044297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3df9b892-3a7e-4984-a090-785c5ecdea8d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:47.044761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3df9b892-3a7e-4984-a090-785c5ecdea8d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:47.098116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-221dd9f6-7f98-45b1-adf2-ee0143df35d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:47.105684 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-221dd9f6-7f98-45b1-adf2-ee0143df35d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.163675 Jun 20 06:28:47.106334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 686/1365] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:47.117789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3df9b892-3a7e-4984-a090-785c5ecdea8d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:47.126192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3df9b892-3a7e-4984-a090-785c5ecdea8d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.095006 Jun 20 06:28:47.126467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 680/1366] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:47 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:48.123576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e4640a9b-545c-4c04-936e-c03e82c4fffc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:48.124114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e4640a9b-545c-4c04-936e-c03e82c4fffc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:48.131210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4640a9b-545c-4c04-936e-c03e82c4fffc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:48.131661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4640a9b-545c-4c04-936e-c03e82c4fffc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:48.132425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4640a9b-545c-4c04-936e-c03e82c4fffc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:48.132858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4640a9b-545c-4c04-936e-c03e82c4fffc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:48.141827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24826858-d837-4ac7-81cf-438189cfe3bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:48.142568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24826858-d837-4ac7-81cf-438189cfe3bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:48.148997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24826858-d837-4ac7-81cf-438189cfe3bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:48.149480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24826858-d837-4ac7-81cf-438189cfe3bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:48.150257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24826858-d837-4ac7-81cf-438189cfe3bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:48.150695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24826858-d837-4ac7-81cf-438189cfe3bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:48.228994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24826858-d837-4ac7-81cf-438189cfe3bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:48.237769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24826858-d837-4ac7-81cf-438189cfe3bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.099987 Jun 20 06:28:48.238342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 681/1367] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:48 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:28:48.288031 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e4640a9b-545c-4c04-936e-c03e82c4fffc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:48.290188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:48.296692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e4640a9b-545c-4c04-936e-c03e82c4fffc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.177119 Jun 20 06:28:48.297830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 687/1368] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:49.254929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-476b4941-3d2e-4fff-a035-86430d14dacf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:49.255553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-476b4941-3d2e-4fff-a035-86430d14dacf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:49.261933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-476b4941-3d2e-4fff-a035-86430d14dacf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:49.262374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-476b4941-3d2e-4fff-a035-86430d14dacf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:49.263126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-476b4941-3d2e-4fff-a035-86430d14dacf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:49.263558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-476b4941-3d2e-4fff-a035-86430d14dacf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:49.315327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-74ac73f1-03fe-4c83-be39-b6a5ae2866d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:49.316164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-74ac73f1-03fe-4c83-be39-b6a5ae2866d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:49.323053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-74ac73f1-03fe-4c83-be39-b6a5ae2866d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:49.323176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-74ac73f1-03fe-4c83-be39-b6a5ae2866d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:49.323885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-74ac73f1-03fe-4c83-be39-b6a5ae2866d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:49.324392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-74ac73f1-03fe-4c83-be39-b6a5ae2866d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:49.326489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-476b4941-3d2e-4fff-a035-86430d14dacf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:49.333070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-476b4941-3d2e-4fff-a035-86430d14dacf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081896 Jun 20 06:28:49.333682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 682/1369] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:49 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:49.455117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-74ac73f1-03fe-4c83-be39-b6a5ae2866d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:49.462567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-74ac73f1-03fe-4c83-be39-b6a5ae2866d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151680 Jun 20 06:28:49.463122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 688/1370] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:28:50.350207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f510a21-47fc-4d35-87e9-344f3d40205f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:50.350819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f510a21-47fc-4d35-87e9-344f3d40205f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:50.357254 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f510a21-47fc-4d35-87e9-344f3d40205f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:50.357732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f510a21-47fc-4d35-87e9-344f3d40205f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:50.358492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f510a21-47fc-4d35-87e9-344f3d40205f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:50.358926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f510a21-47fc-4d35-87e9-344f3d40205f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:50.419178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f510a21-47fc-4d35-87e9-344f3d40205f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:50.426605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f510a21-47fc-4d35-87e9-344f3d40205f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080313 Jun 20 06:28:50.427168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 683/1371] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:50 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:50.479681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0f6eba79-eb45-4594-b91f-289a75f60d70 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:50.480399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0f6eba79-eb45-4594-b91f-289a75f60d70 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:50.488062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f6eba79-eb45-4594-b91f-289a75f60d70 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:50.488502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f6eba79-eb45-4594-b91f-289a75f60d70 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:50.489274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f6eba79-eb45-4594-b91f-289a75f60d70 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:50.489737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f6eba79-eb45-4594-b91f-289a75f60d70 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:50.623871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0f6eba79-eb45-4594-b91f-289a75f60d70 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:50.632592 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0f6eba79-eb45-4594-b91f-289a75f60d70 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157121 Jun 20 06:28:50.633160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 689/1372] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:51.443153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd79b6b5-b433-4e07-993d-bc2ca5eeaa70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:51.443764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd79b6b5-b433-4e07-993d-bc2ca5eeaa70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:51.450169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd79b6b5-b433-4e07-993d-bc2ca5eeaa70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:51.450611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd79b6b5-b433-4e07-993d-bc2ca5eeaa70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:51.451361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd79b6b5-b433-4e07-993d-bc2ca5eeaa70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:51.451790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd79b6b5-b433-4e07-993d-bc2ca5eeaa70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:51.512355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd79b6b5-b433-4e07-993d-bc2ca5eeaa70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:51.520640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd79b6b5-b433-4e07-993d-bc2ca5eeaa70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081368 Jun 20 06:28:51.521204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 684/1373] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:51 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:51.650533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2c1462d8-57c7-4d10-a965-dc9be56ba946 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:51.651145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2c1462d8-57c7-4d10-a965-dc9be56ba946 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:51.658191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c1462d8-57c7-4d10-a965-dc9be56ba946 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:51.658640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c1462d8-57c7-4d10-a965-dc9be56ba946 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:51.659396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c1462d8-57c7-4d10-a965-dc9be56ba946 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:51.659831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c1462d8-57c7-4d10-a965-dc9be56ba946 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:51.786919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2c1462d8-57c7-4d10-a965-dc9be56ba946 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:51.794288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2c1462d8-57c7-4d10-a965-dc9be56ba946 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147616 Jun 20 06:28:51.794882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 690/1374] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:52.538903 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-358f16b9-70ac-4790-b88a-bf624b21a788 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:52.539527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-358f16b9-70ac-4790-b88a-bf624b21a788 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:52.546081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-358f16b9-70ac-4790-b88a-bf624b21a788 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:52.546530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-358f16b9-70ac-4790-b88a-bf624b21a788 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:52.548412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-358f16b9-70ac-4790-b88a-bf624b21a788 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:52.548855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-358f16b9-70ac-4790-b88a-bf624b21a788 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:52.612122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-358f16b9-70ac-4790-b88a-bf624b21a788 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:52.619652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-358f16b9-70ac-4790-b88a-bf624b21a788 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084830 Jun 20 06:28:52.620217 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 685/1375] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:52 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:52.811191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9a120f14-89f5-4253-b4f9-8fd3b3518466 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:52.811804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9a120f14-89f5-4253-b4f9-8fd3b3518466 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:52.818427 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a120f14-89f5-4253-b4f9-8fd3b3518466 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:52.818873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a120f14-89f5-4253-b4f9-8fd3b3518466 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:52.819628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a120f14-89f5-4253-b4f9-8fd3b3518466 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:52.820089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a120f14-89f5-4253-b4f9-8fd3b3518466 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:52.953864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a120f14-89f5-4253-b4f9-8fd3b3518466 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:52.961155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9a120f14-89f5-4253-b4f9-8fd3b3518466 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153773 Jun 20 06:28:52.961758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 691/1376] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:53.636687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-73e2de35-7dd1-4c11-bc47-9c888d6e2e6d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:53.637307 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-73e2de35-7dd1-4c11-bc47-9c888d6e2e6d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:53.644786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73e2de35-7dd1-4c11-bc47-9c888d6e2e6d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:53.645238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73e2de35-7dd1-4c11-bc47-9c888d6e2e6d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:53.646035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73e2de35-7dd1-4c11-bc47-9c888d6e2e6d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:53.646475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-73e2de35-7dd1-4c11-bc47-9c888d6e2e6d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:53.650362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:53.707191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-73e2de35-7dd1-4c11-bc47-9c888d6e2e6d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:53.714879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-73e2de35-7dd1-4c11-bc47-9c888d6e2e6d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081983 Jun 20 06:28:53.715448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 686/1377] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:53 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:53.979143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8f32b5bb-45f0-473f-96d5-03a269c600ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:53.979703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8f32b5bb-45f0-473f-96d5-03a269c600ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:53.986889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f32b5bb-45f0-473f-96d5-03a269c600ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:53.987333 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f32b5bb-45f0-473f-96d5-03a269c600ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:53.988080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f32b5bb-45f0-473f-96d5-03a269c600ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:53.988508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f32b5bb-45f0-473f-96d5-03a269c600ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:54.120100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8f32b5bb-45f0-473f-96d5-03a269c600ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:54.127655 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8f32b5bb-45f0-473f-96d5-03a269c600ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152408 Jun 20 06:28:54.128212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 692/1378] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:53 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:54.730793 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40d85744-7598-4fc3-b0ec-5503919212dc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:54.731399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40d85744-7598-4fc3-b0ec-5503919212dc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:54.738238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40d85744-7598-4fc3-b0ec-5503919212dc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:54.738682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40d85744-7598-4fc3-b0ec-5503919212dc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:54.739433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40d85744-7598-4fc3-b0ec-5503919212dc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:54.739864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40d85744-7598-4fc3-b0ec-5503919212dc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:54.804969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40d85744-7598-4fc3-b0ec-5503919212dc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:54.813067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40d85744-7598-4fc3-b0ec-5503919212dc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085516 Jun 20 06:28:54.813668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 687/1379] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:54 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:55.145409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-16984663-da31-4d25-a4a5-f2c6a579390b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:55.146033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-16984663-da31-4d25-a4a5-f2c6a579390b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:55.152450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-16984663-da31-4d25-a4a5-f2c6a579390b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:55.152926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-16984663-da31-4d25-a4a5-f2c6a579390b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:55.153741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-16984663-da31-4d25-a4a5-f2c6a579390b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:55.154172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-16984663-da31-4d25-a4a5-f2c6a579390b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:55.284023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-16984663-da31-4d25-a4a5-f2c6a579390b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:55.291361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-16984663-da31-4d25-a4a5-f2c6a579390b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150594 Jun 20 06:28:55.291931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 693/1380] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:55.833667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e679dfa7-35c8-46f9-ac49-eb96bb428e9f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:55.834306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e679dfa7-35c8-46f9-ac49-eb96bb428e9f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:55.840776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e679dfa7-35c8-46f9-ac49-eb96bb428e9f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:55.841223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e679dfa7-35c8-46f9-ac49-eb96bb428e9f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:55.842020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e679dfa7-35c8-46f9-ac49-eb96bb428e9f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:55.842459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e679dfa7-35c8-46f9-ac49-eb96bb428e9f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:55.903494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e679dfa7-35c8-46f9-ac49-eb96bb428e9f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:55.911859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e679dfa7-35c8-46f9-ac49-eb96bb428e9f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082101 Jun 20 06:28:55.912422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 688/1381] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:55 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:56.309541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db10809e-d489-4da9-bee8-c4e7d2209081 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:56.310154 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-db10809e-d489-4da9-bee8-c4e7d2209081 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:56.317111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db10809e-d489-4da9-bee8-c4e7d2209081 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:56.317664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db10809e-d489-4da9-bee8-c4e7d2209081 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:56.318432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db10809e-d489-4da9-bee8-c4e7d2209081 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:56.318866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db10809e-d489-4da9-bee8-c4e7d2209081 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:56.451253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-db10809e-d489-4da9-bee8-c4e7d2209081 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:56.459410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-db10809e-d489-4da9-bee8-c4e7d2209081 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153753 Jun 20 06:28:56.459970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 694/1382] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:56.928457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0ee52030-f23b-4880-a86a-3e7c86b0dbdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:56.929065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0ee52030-f23b-4880-a86a-3e7c86b0dbdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:56.935445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ee52030-f23b-4880-a86a-3e7c86b0dbdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:56.935891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ee52030-f23b-4880-a86a-3e7c86b0dbdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:56.936642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ee52030-f23b-4880-a86a-3e7c86b0dbdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:56.937704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ee52030-f23b-4880-a86a-3e7c86b0dbdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:56.997266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0ee52030-f23b-4880-a86a-3e7c86b0dbdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:57.005463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0ee52030-f23b-4880-a86a-3e7c86b0dbdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080789 Jun 20 06:28:57.006023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 689/1383] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:56 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:57.477343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-97ff8d67-0409-43bc-bc1c-e44cedc68085 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:57.477976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-97ff8d67-0409-43bc-bc1c-e44cedc68085 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:57.484915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97ff8d67-0409-43bc-bc1c-e44cedc68085 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:57.485361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97ff8d67-0409-43bc-bc1c-e44cedc68085 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:57.486144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97ff8d67-0409-43bc-bc1c-e44cedc68085 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:57.486575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97ff8d67-0409-43bc-bc1c-e44cedc68085 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:57.617657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-97ff8d67-0409-43bc-bc1c-e44cedc68085 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:57.625264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-97ff8d67-0409-43bc-bc1c-e44cedc68085 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151610 Jun 20 06:28:57.625842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 695/1384] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:58.022852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-86e03449-f4f4-4ee7-9654-46e663ff3c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:58.023440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-86e03449-f4f4-4ee7-9654-46e663ff3c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:58.029939 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86e03449-f4f4-4ee7-9654-46e663ff3c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:58.030381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86e03449-f4f4-4ee7-9654-46e663ff3c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:58.031333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86e03449-f4f4-4ee7-9654-46e663ff3c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:58.031857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86e03449-f4f4-4ee7-9654-46e663ff3c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:58.092516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-86e03449-f4f4-4ee7-9654-46e663ff3c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:58.099865 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-86e03449-f4f4-4ee7-9654-46e663ff3c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080829 Jun 20 06:28:58.100423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 690/1385] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:58 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:58.643229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1fcaec80-f07e-4ee7-990a-09d3a3ba2681 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:58.643845 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1fcaec80-f07e-4ee7-990a-09d3a3ba2681 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:58.650238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1fcaec80-f07e-4ee7-990a-09d3a3ba2681 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:58.650688 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1fcaec80-f07e-4ee7-990a-09d3a3ba2681 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:58.651444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1fcaec80-f07e-4ee7-990a-09d3a3ba2681 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:58.651882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1fcaec80-f07e-4ee7-990a-09d3a3ba2681 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:58.789272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1fcaec80-f07e-4ee7-990a-09d3a3ba2681 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:58.797614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1fcaec80-f07e-4ee7-990a-09d3a3ba2681 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.158224 Jun 20 06:28:58.798172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 696/1386] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:59.116028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8d0430fe-42e9-44d0-a6b3-428a2755fabf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:59.116566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8d0430fe-42e9-44d0-a6b3-428a2755fabf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:59.123022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8d0430fe-42e9-44d0-a6b3-428a2755fabf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:59.123474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8d0430fe-42e9-44d0-a6b3-428a2755fabf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:59.124230 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8d0430fe-42e9-44d0-a6b3-428a2755fabf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:59.124667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8d0430fe-42e9-44d0-a6b3-428a2755fabf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:59.185969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8d0430fe-42e9-44d0-a6b3-428a2755fabf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:59.193521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8d0430fe-42e9-44d0-a6b3-428a2755fabf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081386 Jun 20 06:28:59.194080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 691/1387] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:59 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:28:59.815687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-155da6b7-2e82-4e5f-ae5e-31cda010ddb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:28:59.816304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-155da6b7-2e82-4e5f-ae5e-31cda010ddb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:28:59.822750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-155da6b7-2e82-4e5f-ae5e-31cda010ddb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:59.823188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-155da6b7-2e82-4e5f-ae5e-31cda010ddb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:59.823934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-155da6b7-2e82-4e5f-ae5e-31cda010ddb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:28:59.824364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-155da6b7-2e82-4e5f-ae5e-31cda010ddb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:28:59.955603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-155da6b7-2e82-4e5f-ae5e-31cda010ddb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:28:59.963085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-155da6b7-2e82-4e5f-ae5e-31cda010ddb6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152003 Jun 20 06:28:59.963679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 697/1388] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:28:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:00.210487 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-135eff83-55ca-4996-9d3a-99740cfaa212 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:00.211119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-135eff83-55ca-4996-9d3a-99740cfaa212 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:00.217534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-135eff83-55ca-4996-9d3a-99740cfaa212 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:00.217980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-135eff83-55ca-4996-9d3a-99740cfaa212 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:00.219295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-135eff83-55ca-4996-9d3a-99740cfaa212 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:00.219654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-135eff83-55ca-4996-9d3a-99740cfaa212 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:00.279466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-135eff83-55ca-4996-9d3a-99740cfaa212 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:00.290094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-135eff83-55ca-4996-9d3a-99740cfaa212 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083341 Jun 20 06:29:00.290682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 692/1389] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:00 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:00.980138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f95bc42-e66c-4db3-b317-87c06c8e9103 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:00.980751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f95bc42-e66c-4db3-b317-87c06c8e9103 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:00.987211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f95bc42-e66c-4db3-b317-87c06c8e9103 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:00.987670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f95bc42-e66c-4db3-b317-87c06c8e9103 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:00.988417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f95bc42-e66c-4db3-b317-87c06c8e9103 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:00.988844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f95bc42-e66c-4db3-b317-87c06c8e9103 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:01.120678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7f95bc42-e66c-4db3-b317-87c06c8e9103 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:01.128832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f95bc42-e66c-4db3-b317-87c06c8e9103 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152693 Jun 20 06:29:01.129411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 698/1390] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:01.307673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-05b70d1d-2d21-4ae9-91c3-be4da93f05ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:01.308209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-05b70d1d-2d21-4ae9-91c3-be4da93f05ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:01.315479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05b70d1d-2d21-4ae9-91c3-be4da93f05ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:01.315933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05b70d1d-2d21-4ae9-91c3-be4da93f05ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:01.316708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05b70d1d-2d21-4ae9-91c3-be4da93f05ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:01.317146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05b70d1d-2d21-4ae9-91c3-be4da93f05ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:01.378850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-05b70d1d-2d21-4ae9-91c3-be4da93f05ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:01.386308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-05b70d1d-2d21-4ae9-91c3-be4da93f05ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082529 Jun 20 06:29:01.386863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 693/1391] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:01 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:02.146601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-64a4801c-2949-41f8-af0d-3139ada054f0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:02.147210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-64a4801c-2949-41f8-af0d-3139ada054f0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:02.153631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64a4801c-2949-41f8-af0d-3139ada054f0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:02.154072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64a4801c-2949-41f8-af0d-3139ada054f0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:02.154816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64a4801c-2949-41f8-af0d-3139ada054f0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:02.155244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64a4801c-2949-41f8-af0d-3139ada054f0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:02.283100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-64a4801c-2949-41f8-af0d-3139ada054f0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:02.290568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-64a4801c-2949-41f8-af0d-3139ada054f0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147733 Jun 20 06:29:02.291132 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 699/1392] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:02.403122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-61a7d256-70b2-4482-9c58-6f1677e9bf45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:02.403730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-61a7d256-70b2-4482-9c58-6f1677e9bf45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:02.410578 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61a7d256-70b2-4482-9c58-6f1677e9bf45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:02.411022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61a7d256-70b2-4482-9c58-6f1677e9bf45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:02.411770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61a7d256-70b2-4482-9c58-6f1677e9bf45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:02.412203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61a7d256-70b2-4482-9c58-6f1677e9bf45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:02.473117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-61a7d256-70b2-4482-9c58-6f1677e9bf45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:02.480565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-61a7d256-70b2-4482-9c58-6f1677e9bf45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081304 Jun 20 06:29:02.481128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 694/1393] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:02 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:03.308002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-08efcda2-45b3-496d-ac41-615750532038 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:03.308605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-08efcda2-45b3-496d-ac41-615750532038 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:03.314772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08efcda2-45b3-496d-ac41-615750532038 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:03.315210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08efcda2-45b3-496d-ac41-615750532038 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:03.315967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08efcda2-45b3-496d-ac41-615750532038 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:03.316391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08efcda2-45b3-496d-ac41-615750532038 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:03.446867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-08efcda2-45b3-496d-ac41-615750532038 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:03.454835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-08efcda2-45b3-496d-ac41-615750532038 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150864 Jun 20 06:29:03.455394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 700/1394] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:03.497290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3fd1089b-eded-42f3-9729-464b6c236447 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:03.497932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3fd1089b-eded-42f3-9729-464b6c236447 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:03.504527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fd1089b-eded-42f3-9729-464b6c236447 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:03.504981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fd1089b-eded-42f3-9729-464b6c236447 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:03.505781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fd1089b-eded-42f3-9729-464b6c236447 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:03.506222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fd1089b-eded-42f3-9729-464b6c236447 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:03.567758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3fd1089b-eded-42f3-9729-464b6c236447 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:03.575169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3fd1089b-eded-42f3-9729-464b6c236447 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081773 Jun 20 06:29:03.575735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 695/1395] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:03 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:04.472125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dbab56de-f580-4732-a824-46384820b746 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:04.472729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dbab56de-f580-4732-a824-46384820b746 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:04.479157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dbab56de-f580-4732-a824-46384820b746 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:04.479595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dbab56de-f580-4732-a824-46384820b746 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:04.480342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dbab56de-f580-4732-a824-46384820b746 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:04.480770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dbab56de-f580-4732-a824-46384820b746 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:04.592006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8c9f273b-45ef-49ac-8f5f-cd0703296f55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:04.592622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8c9f273b-45ef-49ac-8f5f-cd0703296f55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:04.599801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c9f273b-45ef-49ac-8f5f-cd0703296f55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:04.600325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c9f273b-45ef-49ac-8f5f-cd0703296f55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:04.601091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c9f273b-45ef-49ac-8f5f-cd0703296f55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:04.601557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c9f273b-45ef-49ac-8f5f-cd0703296f55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:04.615415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dbab56de-f580-4732-a824-46384820b746 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:04.622955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dbab56de-f580-4732-a824-46384820b746 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154693 Jun 20 06:29:04.623534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 701/1396] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:04.662546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8c9f273b-45ef-49ac-8f5f-cd0703296f55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:04.670121 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8c9f273b-45ef-49ac-8f5f-cd0703296f55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082010 Jun 20 06:29:04.670688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 696/1397] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:04 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:05.641757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-06fdc3c8-991e-45a8-9c1b-0b96fe5a6347 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:05.642805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-06fdc3c8-991e-45a8-9c1b-0b96fe5a6347 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:05.648953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06fdc3c8-991e-45a8-9c1b-0b96fe5a6347 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:05.649428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06fdc3c8-991e-45a8-9c1b-0b96fe5a6347 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:05.650195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06fdc3c8-991e-45a8-9c1b-0b96fe5a6347 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:05.650656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06fdc3c8-991e-45a8-9c1b-0b96fe5a6347 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:05.687678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7603ceb8-c16a-43fc-b985-db7a57140e3d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:05.688330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7603ceb8-c16a-43fc-b985-db7a57140e3d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:05.695225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7603ceb8-c16a-43fc-b985-db7a57140e3d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:05.695679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7603ceb8-c16a-43fc-b985-db7a57140e3d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:05.696462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7603ceb8-c16a-43fc-b985-db7a57140e3d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:05.696903 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7603ceb8-c16a-43fc-b985-db7a57140e3d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:05.772995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7603ceb8-c16a-43fc-b985-db7a57140e3d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:05.780449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7603ceb8-c16a-43fc-b985-db7a57140e3d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.097206 Jun 20 06:29:05.781042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 697/1398] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:05 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:05.804887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-06fdc3c8-991e-45a8-9c1b-0b96fe5a6347 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:05.813080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-06fdc3c8-991e-45a8-9c1b-0b96fe5a6347 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.176412 Jun 20 06:29:05.813680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 702/1399] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:06.797175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3b2bfd43-5912-45c3-bf98-5786149b1c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:06.797820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3b2bfd43-5912-45c3-bf98-5786149b1c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:06.804205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b2bfd43-5912-45c3-bf98-5786149b1c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:06.804647 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b2bfd43-5912-45c3-bf98-5786149b1c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:06.805417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b2bfd43-5912-45c3-bf98-5786149b1c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:06.805856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b2bfd43-5912-45c3-bf98-5786149b1c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:06.831310 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-19b3f33e-525b-4f9c-bcb6-e5bb5db45c03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:06.831922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-19b3f33e-525b-4f9c-bcb6-e5bb5db45c03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:06.838418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19b3f33e-525b-4f9c-bcb6-e5bb5db45c03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:06.838867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19b3f33e-525b-4f9c-bcb6-e5bb5db45c03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:06.839631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19b3f33e-525b-4f9c-bcb6-e5bb5db45c03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:06.840068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19b3f33e-525b-4f9c-bcb6-e5bb5db45c03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:06.869110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b2bfd43-5912-45c3-bf98-5786149b1c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:06.877352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3b2bfd43-5912-45c3-bf98-5786149b1c19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084103 Jun 20 06:29:06.877959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 698/1400] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:06 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:06.970522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-19b3f33e-525b-4f9c-bcb6-e5bb5db45c03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:06.978028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-19b3f33e-525b-4f9c-bcb6-e5bb5db45c03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151704 Jun 20 06:29:06.978585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 703/1401] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:07.894831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-006c07d9-d2b6-4021-84bb-e3c3b4d0fa4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:07.895443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-006c07d9-d2b6-4021-84bb-e3c3b4d0fa4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:07.901948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-006c07d9-d2b6-4021-84bb-e3c3b4d0fa4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:07.902396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-006c07d9-d2b6-4021-84bb-e3c3b4d0fa4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:07.903152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-006c07d9-d2b6-4021-84bb-e3c3b4d0fa4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:07.903592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-006c07d9-d2b6-4021-84bb-e3c3b4d0fa4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:07.963327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-006c07d9-d2b6-4021-84bb-e3c3b4d0fa4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:07.971308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-006c07d9-d2b6-4021-84bb-e3c3b4d0fa4d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081222 Jun 20 06:29:07.971866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 699/1402] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:07 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:07.995253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d9803d39-82bf-489a-b5a3-7a48111c12b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:07.995870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d9803d39-82bf-489a-b5a3-7a48111c12b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:08.002921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9803d39-82bf-489a-b5a3-7a48111c12b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:08.003368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9803d39-82bf-489a-b5a3-7a48111c12b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:08.004131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9803d39-82bf-489a-b5a3-7a48111c12b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:08.004570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9803d39-82bf-489a-b5a3-7a48111c12b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:08.019775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:08.136555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d9803d39-82bf-489a-b5a3-7a48111c12b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:08.144999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d9803d39-82bf-489a-b5a3-7a48111c12b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153483 Jun 20 06:29:08.145556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 704/1403] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:08.988538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-96e85a0a-6def-402f-b38a-372992c2949e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:08.989157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-96e85a0a-6def-402f-b38a-372992c2949e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:08.995819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96e85a0a-6def-402f-b38a-372992c2949e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:08.996276 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96e85a0a-6def-402f-b38a-372992c2949e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:08.997043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96e85a0a-6def-402f-b38a-372992c2949e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:08.997513 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96e85a0a-6def-402f-b38a-372992c2949e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:09.060537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-96e85a0a-6def-402f-b38a-372992c2949e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:09.068105 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-96e85a0a-6def-402f-b38a-372992c2949e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083457 Jun 20 06:29:09.068676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 700/1404] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:08 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:09.162426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-27f30b3a-f046-452e-b4a9-b6721210809b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:09.163035 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-27f30b3a-f046-452e-b4a9-b6721210809b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:09.169413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27f30b3a-f046-452e-b4a9-b6721210809b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:09.169863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27f30b3a-f046-452e-b4a9-b6721210809b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:09.170612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27f30b3a-f046-452e-b4a9-b6721210809b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:09.171714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27f30b3a-f046-452e-b4a9-b6721210809b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:09.299475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-27f30b3a-f046-452e-b4a9-b6721210809b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:09.306879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-27f30b3a-f046-452e-b4a9-b6721210809b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148312 Jun 20 06:29:09.307432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 705/1405] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:10.084675 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-01bda665-6ba8-43a9-ba43-173e3c6d90dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:10.085262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-01bda665-6ba8-43a9-ba43-173e3c6d90dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:10.091733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01bda665-6ba8-43a9-ba43-173e3c6d90dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:10.092185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01bda665-6ba8-43a9-ba43-173e3c6d90dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:10.093587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01bda665-6ba8-43a9-ba43-173e3c6d90dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:10.094024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01bda665-6ba8-43a9-ba43-173e3c6d90dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:10.157708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-01bda665-6ba8-43a9-ba43-173e3c6d90dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:10.165171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-01bda665-6ba8-43a9-ba43-173e3c6d90dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084302 Jun 20 06:29:10.165768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 701/1406] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:10 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:10.324003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9e3c55fd-6262-40cd-b1ae-2db1f67f9f76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:10.324619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9e3c55fd-6262-40cd-b1ae-2db1f67f9f76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:10.331765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e3c55fd-6262-40cd-b1ae-2db1f67f9f76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:10.332211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e3c55fd-6262-40cd-b1ae-2db1f67f9f76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:10.332973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e3c55fd-6262-40cd-b1ae-2db1f67f9f76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:10.333592 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e3c55fd-6262-40cd-b1ae-2db1f67f9f76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:10.465273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9e3c55fd-6262-40cd-b1ae-2db1f67f9f76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:10.472775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9e3c55fd-6262-40cd-b1ae-2db1f67f9f76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152616 Jun 20 06:29:10.473547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 706/1407] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:10 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:11.182891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f12b1ceb-058a-48a9-bcea-690dc8d2e25a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:11.183509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f12b1ceb-058a-48a9-bcea-690dc8d2e25a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:11.190162 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f12b1ceb-058a-48a9-bcea-690dc8d2e25a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:11.190617 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f12b1ceb-058a-48a9-bcea-690dc8d2e25a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:11.191380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f12b1ceb-058a-48a9-bcea-690dc8d2e25a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:11.191819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f12b1ceb-058a-48a9-bcea-690dc8d2e25a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:11.254070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f12b1ceb-058a-48a9-bcea-690dc8d2e25a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:11.256262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:11.262794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f12b1ceb-058a-48a9-bcea-690dc8d2e25a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083756 Jun 20 06:29:11.263359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 702/1408] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:11 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:11.490748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d0b8b387-56af-4e18-add4-99695ca0700d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:11.491261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d0b8b387-56af-4e18-add4-99695ca0700d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:11.497629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0b8b387-56af-4e18-add4-99695ca0700d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:11.498071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0b8b387-56af-4e18-add4-99695ca0700d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:11.498816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0b8b387-56af-4e18-add4-99695ca0700d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:11.499243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0b8b387-56af-4e18-add4-99695ca0700d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:11.629766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d0b8b387-56af-4e18-add4-99695ca0700d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:11.637160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d0b8b387-56af-4e18-add4-99695ca0700d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150292 Jun 20 06:29:11.637744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 707/1409] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:12.279732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-88f20b66-4472-4f5a-839b-55fc6eee8a5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:12.280455 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-88f20b66-4472-4f5a-839b-55fc6eee8a5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:12.287740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88f20b66-4472-4f5a-839b-55fc6eee8a5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:12.288187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88f20b66-4472-4f5a-839b-55fc6eee8a5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:12.288950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88f20b66-4472-4f5a-839b-55fc6eee8a5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:12.289400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88f20b66-4472-4f5a-839b-55fc6eee8a5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:12.353455 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-88f20b66-4472-4f5a-839b-55fc6eee8a5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:12.361524 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-88f20b66-4472-4f5a-839b-55fc6eee8a5d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085603 Jun 20 06:29:12.362088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 703/1410] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:12 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:12.655578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5d53f573-5393-4a5e-8129-d629cbc863cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:12.656279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5d53f573-5393-4a5e-8129-d629cbc863cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:12.658609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:12.663681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5d53f573-5393-4a5e-8129-d629cbc863cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:12.664113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5d53f573-5393-4a5e-8129-d629cbc863cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:12.664875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5d53f573-5393-4a5e-8129-d629cbc863cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:12.665308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5d53f573-5393-4a5e-8129-d629cbc863cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:12.801848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5d53f573-5393-4a5e-8129-d629cbc863cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:12.809261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5d53f573-5393-4a5e-8129-d629cbc863cf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157578 Jun 20 06:29:12.809866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 708/1411] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:13.378099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-355dcecf-3e1c-439e-8bff-9c9a8da6b55b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:13.378699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-355dcecf-3e1c-439e-8bff-9c9a8da6b55b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:13.385321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-355dcecf-3e1c-439e-8bff-9c9a8da6b55b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:13.385795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-355dcecf-3e1c-439e-8bff-9c9a8da6b55b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:13.386545 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-355dcecf-3e1c-439e-8bff-9c9a8da6b55b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:13.386977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-355dcecf-3e1c-439e-8bff-9c9a8da6b55b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:13.450256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-355dcecf-3e1c-439e-8bff-9c9a8da6b55b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:13.458293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-355dcecf-3e1c-439e-8bff-9c9a8da6b55b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084025 Jun 20 06:29:13.458864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 704/1412] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:13 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:13.826528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57022124-dd9b-458b-ac75-7e78a2b3167c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:13.827715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-57022124-dd9b-458b-ac75-7e78a2b3167c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:13.834358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57022124-dd9b-458b-ac75-7e78a2b3167c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:13.834809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57022124-dd9b-458b-ac75-7e78a2b3167c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:13.835600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57022124-dd9b-458b-ac75-7e78a2b3167c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:13.836036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57022124-dd9b-458b-ac75-7e78a2b3167c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:13.968614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-57022124-dd9b-458b-ac75-7e78a2b3167c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:13.976081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-57022124-dd9b-458b-ac75-7e78a2b3167c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153475 Jun 20 06:29:13.976639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 709/1413] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:14.475042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd3f3ad9-2c6c-4305-bf14-cd7adc9f4075 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:14.475649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd3f3ad9-2c6c-4305-bf14-cd7adc9f4075 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:14.481863 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd3f3ad9-2c6c-4305-bf14-cd7adc9f4075 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:14.482309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd3f3ad9-2c6c-4305-bf14-cd7adc9f4075 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:14.483060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd3f3ad9-2c6c-4305-bf14-cd7adc9f4075 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:14.483667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd3f3ad9-2c6c-4305-bf14-cd7adc9f4075 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:14.545822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd3f3ad9-2c6c-4305-bf14-cd7adc9f4075 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:14.554161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd3f3ad9-2c6c-4305-bf14-cd7adc9f4075 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082907 Jun 20 06:29:14.554727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 705/1414] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:14 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:14.995152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e74e4688-3fbd-496d-b639-5cecdfa4e786 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:14.995878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e74e4688-3fbd-496d-b639-5cecdfa4e786 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:15.002384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e74e4688-3fbd-496d-b639-5cecdfa4e786 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:15.002831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e74e4688-3fbd-496d-b639-5cecdfa4e786 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:15.003589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e74e4688-3fbd-496d-b639-5cecdfa4e786 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:15.004024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e74e4688-3fbd-496d-b639-5cecdfa4e786 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:15.134063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e74e4688-3fbd-496d-b639-5cecdfa4e786 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:15.142338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e74e4688-3fbd-496d-b639-5cecdfa4e786 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151266 Jun 20 06:29:15.142905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 710/1415] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:15.570929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e535a759-58b8-49c1-8205-819cfe18e78e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:15.571531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e535a759-58b8-49c1-8205-819cfe18e78e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:15.573881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:15.579380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e535a759-58b8-49c1-8205-819cfe18e78e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:15.579831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e535a759-58b8-49c1-8205-819cfe18e78e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:15.580587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e535a759-58b8-49c1-8205-819cfe18e78e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:15.581021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e535a759-58b8-49c1-8205-819cfe18e78e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:15.642822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e535a759-58b8-49c1-8205-819cfe18e78e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:15.650447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e535a759-58b8-49c1-8205-819cfe18e78e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083392 Jun 20 06:29:15.651010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 706/1416] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:15 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:16.159494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b4f04cee-4f99-4a8d-a494-debe9a227c25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:16.160103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b4f04cee-4f99-4a8d-a494-debe9a227c25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:16.168088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4f04cee-4f99-4a8d-a494-debe9a227c25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:16.168567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4f04cee-4f99-4a8d-a494-debe9a227c25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:16.169417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4f04cee-4f99-4a8d-a494-debe9a227c25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:16.170257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4f04cee-4f99-4a8d-a494-debe9a227c25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:16.302971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b4f04cee-4f99-4a8d-a494-debe9a227c25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:16.310453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b4f04cee-4f99-4a8d-a494-debe9a227c25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154862 Jun 20 06:29:16.311028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 711/1417] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:16.667376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-43e07286-cf73-4a53-8209-6c3b949c5c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:16.667995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-43e07286-cf73-4a53-8209-6c3b949c5c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:16.674758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43e07286-cf73-4a53-8209-6c3b949c5c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:16.675212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43e07286-cf73-4a53-8209-6c3b949c5c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:16.675986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43e07286-cf73-4a53-8209-6c3b949c5c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:16.676427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43e07286-cf73-4a53-8209-6c3b949c5c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:16.741915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43e07286-cf73-4a53-8209-6c3b949c5c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:16.750012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-43e07286-cf73-4a53-8209-6c3b949c5c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086432 Jun 20 06:29:16.750518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 707/1418] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:16 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:17.327807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-59a94b20-eff1-47c5-960c-b2a3a34fa1a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:17.328415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-59a94b20-eff1-47c5-960c-b2a3a34fa1a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:17.334931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-59a94b20-eff1-47c5-960c-b2a3a34fa1a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:17.335373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-59a94b20-eff1-47c5-960c-b2a3a34fa1a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:17.336131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-59a94b20-eff1-47c5-960c-b2a3a34fa1a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:17.336564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-59a94b20-eff1-47c5-960c-b2a3a34fa1a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:17.462979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-59a94b20-eff1-47c5-960c-b2a3a34fa1a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:17.471086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-59a94b20-eff1-47c5-960c-b2a3a34fa1a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147217 Jun 20 06:29:17.471671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 712/1419] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:17 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:17.767201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-70a73596-6c9d-4fc7-aa64-e4e7be5ccd95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:17.767805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-70a73596-6c9d-4fc7-aa64-e4e7be5ccd95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:17.774322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70a73596-6c9d-4fc7-aa64-e4e7be5ccd95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:17.774770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70a73596-6c9d-4fc7-aa64-e4e7be5ccd95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:17.775525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70a73596-6c9d-4fc7-aa64-e4e7be5ccd95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:17.775955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70a73596-6c9d-4fc7-aa64-e4e7be5ccd95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:17.836236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-70a73596-6c9d-4fc7-aa64-e4e7be5ccd95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:17.844248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-70a73596-6c9d-4fc7-aa64-e4e7be5ccd95 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081713 Jun 20 06:29:17.844803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 708/1420] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:17 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:18.488597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-739817ee-6dcf-412f-967d-539da29de9f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:18.489194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-739817ee-6dcf-412f-967d-539da29de9f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:18.495685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-739817ee-6dcf-412f-967d-539da29de9f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:18.496131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-739817ee-6dcf-412f-967d-539da29de9f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:18.496882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-739817ee-6dcf-412f-967d-539da29de9f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:18.497623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-739817ee-6dcf-412f-967d-539da29de9f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:18.628140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-739817ee-6dcf-412f-967d-539da29de9f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:18.635605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-739817ee-6dcf-412f-967d-539da29de9f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150796 Jun 20 06:29:18.636159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 713/1421] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:18.861446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cba4c8c1-444c-4e07-9da8-0619fbe2c5d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:18.862103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cba4c8c1-444c-4e07-9da8-0619fbe2c5d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:18.868540 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cba4c8c1-444c-4e07-9da8-0619fbe2c5d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:18.868989 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cba4c8c1-444c-4e07-9da8-0619fbe2c5d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:18.869777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cba4c8c1-444c-4e07-9da8-0619fbe2c5d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:18.870215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cba4c8c1-444c-4e07-9da8-0619fbe2c5d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:18.930469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cba4c8c1-444c-4e07-9da8-0619fbe2c5d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:18.938049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cba4c8c1-444c-4e07-9da8-0619fbe2c5d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081047 Jun 20 06:29:18.938611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 709/1422] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:18 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:19.651993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9e9be80f-e22c-4bad-93a8-ebfeafccd598 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:19.652621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9e9be80f-e22c-4bad-93a8-ebfeafccd598 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:19.660158 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e9be80f-e22c-4bad-93a8-ebfeafccd598 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:19.660601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e9be80f-e22c-4bad-93a8-ebfeafccd598 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:19.661351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e9be80f-e22c-4bad-93a8-ebfeafccd598 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:19.662009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e9be80f-e22c-4bad-93a8-ebfeafccd598 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:19.816412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9e9be80f-e22c-4bad-93a8-ebfeafccd598 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:19.824230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9e9be80f-e22c-4bad-93a8-ebfeafccd598 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.176009 Jun 20 06:29:19.824939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 714/1423] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:19.955507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bacf0cab-302c-4390-ac0e-ca23685115bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:19.956059 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bacf0cab-302c-4390-ac0e-ca23685115bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:19.962675 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bacf0cab-302c-4390-ac0e-ca23685115bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:19.963131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bacf0cab-302c-4390-ac0e-ca23685115bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:19.963912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bacf0cab-302c-4390-ac0e-ca23685115bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:19.964355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bacf0cab-302c-4390-ac0e-ca23685115bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:20.034827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bacf0cab-302c-4390-ac0e-ca23685115bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:20.046311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bacf0cab-302c-4390-ac0e-ca23685115bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.095310 Jun 20 06:29:20.046888 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 710/1424] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:19 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:20.842171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-da802115-e648-4f66-b86a-252d1e9aa61a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:20.843500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-da802115-e648-4f66-b86a-252d1e9aa61a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:20.850055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da802115-e648-4f66-b86a-252d1e9aa61a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:20.850502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da802115-e648-4f66-b86a-252d1e9aa61a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:20.851264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da802115-e648-4f66-b86a-252d1e9aa61a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:20.851699 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da802115-e648-4f66-b86a-252d1e9aa61a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:20.978088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-da802115-e648-4f66-b86a-252d1e9aa61a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:20.985515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-da802115-e648-4f66-b86a-252d1e9aa61a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147199 Jun 20 06:29:20.986080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 715/1425] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:21.064699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-06037be8-c80d-42db-9e33-e0ddb295b22d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:21.065312 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-06037be8-c80d-42db-9e33-e0ddb295b22d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:21.071841 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06037be8-c80d-42db-9e33-e0ddb295b22d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:21.072290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06037be8-c80d-42db-9e33-e0ddb295b22d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:21.073050 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06037be8-c80d-42db-9e33-e0ddb295b22d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:21.073512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-06037be8-c80d-42db-9e33-e0ddb295b22d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:21.133160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-06037be8-c80d-42db-9e33-e0ddb295b22d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:21.141497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-06037be8-c80d-42db-9e33-e0ddb295b22d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081166 Jun 20 06:29:21.142067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 711/1426] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:21 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:22.003426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-951c6cb8-c43e-4b5f-806a-be1e7828ca5c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:22.004036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-951c6cb8-c43e-4b5f-806a-be1e7828ca5c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:22.010472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-951c6cb8-c43e-4b5f-806a-be1e7828ca5c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:22.010915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-951c6cb8-c43e-4b5f-806a-be1e7828ca5c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:22.011663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-951c6cb8-c43e-4b5f-806a-be1e7828ca5c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:22.012095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-951c6cb8-c43e-4b5f-806a-be1e7828ca5c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:22.141977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-951c6cb8-c43e-4b5f-806a-be1e7828ca5c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:22.149266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-951c6cb8-c43e-4b5f-806a-be1e7828ca5c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150349 Jun 20 06:29:22.149851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 716/1427] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:22.158085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2fe34f52-a444-409a-8578-f36715885d60 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:22.158701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2fe34f52-a444-409a-8578-f36715885d60 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:22.165072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fe34f52-a444-409a-8578-f36715885d60 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:22.165556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fe34f52-a444-409a-8578-f36715885d60 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:22.166309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fe34f52-a444-409a-8578-f36715885d60 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:22.166739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fe34f52-a444-409a-8578-f36715885d60 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:22.226780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2fe34f52-a444-409a-8578-f36715885d60 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:22.234627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2fe34f52-a444-409a-8578-f36715885d60 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080498 Jun 20 06:29:22.235189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 712/1428] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:22 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:23.166256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d840577c-6556-44f8-a4eb-4a82a23e94d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:23.166876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d840577c-6556-44f8-a4eb-4a82a23e94d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:23.173774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d840577c-6556-44f8-a4eb-4a82a23e94d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:23.174224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d840577c-6556-44f8-a4eb-4a82a23e94d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:23.174984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d840577c-6556-44f8-a4eb-4a82a23e94d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:23.175417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d840577c-6556-44f8-a4eb-4a82a23e94d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:23.251128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6a2d981d-e7b4-482f-933a-f99d465bb0b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:23.251763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6a2d981d-e7b4-482f-933a-f99d465bb0b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:23.258285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a2d981d-e7b4-482f-933a-f99d465bb0b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:23.258743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a2d981d-e7b4-482f-933a-f99d465bb0b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:23.259514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a2d981d-e7b4-482f-933a-f99d465bb0b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:23.259965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a2d981d-e7b4-482f-933a-f99d465bb0b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:23.316731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d840577c-6556-44f8-a4eb-4a82a23e94d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:23.324397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d840577c-6556-44f8-a4eb-4a82a23e94d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.161969 Jun 20 06:29:23.325180 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 717/1429] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:23.336524 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a2d981d-e7b4-482f-933a-f99d465bb0b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:23.344359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6a2d981d-e7b4-482f-933a-f99d465bb0b2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.097157 Jun 20 06:29:23.344931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 713/1430] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:23 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:24.341908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc577d87-0f1d-44fd-9b61-594f89aa1b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:24.343187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc577d87-0f1d-44fd-9b61-594f89aa1b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:24.349659 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc577d87-0f1d-44fd-9b61-594f89aa1b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:24.350101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc577d87-0f1d-44fd-9b61-594f89aa1b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:24.350843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc577d87-0f1d-44fd-9b61-594f89aa1b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:24.351271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc577d87-0f1d-44fd-9b61-594f89aa1b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:24.362518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-12d219f2-61e6-40b7-8bfd-9cf901e2fdeb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:24.363130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-12d219f2-61e6-40b7-8bfd-9cf901e2fdeb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:24.369598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12d219f2-61e6-40b7-8bfd-9cf901e2fdeb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:24.370054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12d219f2-61e6-40b7-8bfd-9cf901e2fdeb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:24.370824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12d219f2-61e6-40b7-8bfd-9cf901e2fdeb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:24.371263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12d219f2-61e6-40b7-8bfd-9cf901e2fdeb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:24.448208 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-12d219f2-61e6-40b7-8bfd-9cf901e2fdeb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:24.456191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-12d219f2-61e6-40b7-8bfd-9cf901e2fdeb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.098166 Jun 20 06:29:24.456764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 714/1431] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:24 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:24.506680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc577d87-0f1d-44fd-9b61-594f89aa1b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:24.514172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc577d87-0f1d-44fd-9b61-594f89aa1b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.176049 Jun 20 06:29:24.514739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 718/1432] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:24 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:25.473270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-81b416ee-8c05-42cf-99a1-2291fd92eef7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:25.473912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-81b416ee-8c05-42cf-99a1-2291fd92eef7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:25.480317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81b416ee-8c05-42cf-99a1-2291fd92eef7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:25.480766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81b416ee-8c05-42cf-99a1-2291fd92eef7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:25.481559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81b416ee-8c05-42cf-99a1-2291fd92eef7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:25.481997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81b416ee-8c05-42cf-99a1-2291fd92eef7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:25.532608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2c6372aa-583f-4b6a-9103-a3ed32fa28b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:25.533248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2c6372aa-583f-4b6a-9103-a3ed32fa28b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:25.540738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c6372aa-583f-4b6a-9103-a3ed32fa28b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:25.541350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c6372aa-583f-4b6a-9103-a3ed32fa28b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:25.542332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c6372aa-583f-4b6a-9103-a3ed32fa28b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:25.542924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c6372aa-583f-4b6a-9103-a3ed32fa28b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:25.547997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-81b416ee-8c05-42cf-99a1-2291fd92eef7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:25.555338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-81b416ee-8c05-42cf-99a1-2291fd92eef7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085948 Jun 20 06:29:25.555907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 715/1433] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:25 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:25.678739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2c6372aa-583f-4b6a-9103-a3ed32fa28b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:25.687447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2c6372aa-583f-4b6a-9103-a3ed32fa28b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.159552 Jun 20 06:29:25.688024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 719/1434] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:25 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:26.572382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2eb8cd33-f40f-4968-8106-80dfd5cea488 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:26.572993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2eb8cd33-f40f-4968-8106-80dfd5cea488 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:26.579663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2eb8cd33-f40f-4968-8106-80dfd5cea488 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:26.580109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2eb8cd33-f40f-4968-8106-80dfd5cea488 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:26.580928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2eb8cd33-f40f-4968-8106-80dfd5cea488 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:26.581315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2eb8cd33-f40f-4968-8106-80dfd5cea488 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:26.642093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2eb8cd33-f40f-4968-8106-80dfd5cea488 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:26.649435 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2eb8cd33-f40f-4968-8106-80dfd5cea488 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080795 Jun 20 06:29:26.649996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 716/1435] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:26 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:26.704855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a26a74b5-a240-4667-9898-a1873f27ee0b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:26.705532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a26a74b5-a240-4667-9898-a1873f27ee0b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:26.711964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a26a74b5-a240-4667-9898-a1873f27ee0b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:26.712409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a26a74b5-a240-4667-9898-a1873f27ee0b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:26.713164 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a26a74b5-a240-4667-9898-a1873f27ee0b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:26.713638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a26a74b5-a240-4667-9898-a1873f27ee0b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:26.842002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a26a74b5-a240-4667-9898-a1873f27ee0b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:26.850484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a26a74b5-a240-4667-9898-a1873f27ee0b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150502 Jun 20 06:29:26.851048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 720/1436] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:27.666235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5602342e-79a8-4459-b229-9b9857fee5fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:27.666982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5602342e-79a8-4459-b229-9b9857fee5fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:27.674468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5602342e-79a8-4459-b229-9b9857fee5fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:27.674914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5602342e-79a8-4459-b229-9b9857fee5fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:27.675681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5602342e-79a8-4459-b229-9b9857fee5fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:27.676119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5602342e-79a8-4459-b229-9b9857fee5fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:27.738319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5602342e-79a8-4459-b229-9b9857fee5fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:27.745935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5602342e-79a8-4459-b229-9b9857fee5fc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083520 Jun 20 06:29:27.746497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 717/1437] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:27 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:27.867383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-611ffbf6-801e-430c-a478-5dd354c047b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:27.867991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-611ffbf6-801e-430c-a478-5dd354c047b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:27.874772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-611ffbf6-801e-430c-a478-5dd354c047b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:27.875210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-611ffbf6-801e-430c-a478-5dd354c047b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:27.875959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-611ffbf6-801e-430c-a478-5dd354c047b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:27.876388 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-611ffbf6-801e-430c-a478-5dd354c047b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:27.878877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:28.007730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-611ffbf6-801e-430c-a478-5dd354c047b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:28.015245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-611ffbf6-801e-430c-a478-5dd354c047b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151801 Jun 20 06:29:28.015809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 721/1438] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:27 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:28.763036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dc89dfdc-f62f-42c3-8d94-c3acd6102427 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:28.763633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dc89dfdc-f62f-42c3-8d94-c3acd6102427 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:28.771105 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc89dfdc-f62f-42c3-8d94-c3acd6102427 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:28.771552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc89dfdc-f62f-42c3-8d94-c3acd6102427 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:28.772328 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc89dfdc-f62f-42c3-8d94-c3acd6102427 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:28.772766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dc89dfdc-f62f-42c3-8d94-c3acd6102427 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:28.835658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dc89dfdc-f62f-42c3-8d94-c3acd6102427 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:28.843508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dc89dfdc-f62f-42c3-8d94-c3acd6102427 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084337 Jun 20 06:29:28.844067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 718/1439] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:28 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:29.032248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1dd855c6-2a55-4b82-8b4a-75e4c35a9f34 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:29.032779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1dd855c6-2a55-4b82-8b4a-75e4c35a9f34 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:29.039293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1dd855c6-2a55-4b82-8b4a-75e4c35a9f34 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:29.039732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1dd855c6-2a55-4b82-8b4a-75e4c35a9f34 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:29.040482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1dd855c6-2a55-4b82-8b4a-75e4c35a9f34 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:29.040910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1dd855c6-2a55-4b82-8b4a-75e4c35a9f34 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:29.169092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1dd855c6-2a55-4b82-8b4a-75e4c35a9f34 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:29.177444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1dd855c6-2a55-4b82-8b4a-75e4c35a9f34 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149316 Jun 20 06:29:29.178008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 722/1440] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:29.860552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-19034c7b-ac6a-4af3-aa9f-ff94d0c2ac64 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:29.861148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-19034c7b-ac6a-4af3-aa9f-ff94d0c2ac64 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:29.867681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19034c7b-ac6a-4af3-aa9f-ff94d0c2ac64 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:29.868127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19034c7b-ac6a-4af3-aa9f-ff94d0c2ac64 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:29.868887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19034c7b-ac6a-4af3-aa9f-ff94d0c2ac64 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:29.869318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19034c7b-ac6a-4af3-aa9f-ff94d0c2ac64 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:29.884627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:29.932159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-19034c7b-ac6a-4af3-aa9f-ff94d0c2ac64 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:29.940444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-19034c7b-ac6a-4af3-aa9f-ff94d0c2ac64 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084309 Jun 20 06:29:29.941001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 719/1441] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:29 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:30.195142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-83f2f308-bfcc-411a-a017-735202bd2980 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:30.195752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-83f2f308-bfcc-411a-a017-735202bd2980 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:30.202717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83f2f308-bfcc-411a-a017-735202bd2980 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:30.203235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83f2f308-bfcc-411a-a017-735202bd2980 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:30.204003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83f2f308-bfcc-411a-a017-735202bd2980 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:30.204436 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83f2f308-bfcc-411a-a017-735202bd2980 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:30.341858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-83f2f308-bfcc-411a-a017-735202bd2980 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:30.350358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-83f2f308-bfcc-411a-a017-735202bd2980 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.159121 Jun 20 06:29:30.350934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 723/1442] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:30.957970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e267e6fa-4616-46c6-a7d7-20c8f6c9bb15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:30.958576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e267e6fa-4616-46c6-a7d7-20c8f6c9bb15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:30.964997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e267e6fa-4616-46c6-a7d7-20c8f6c9bb15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:30.965474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e267e6fa-4616-46c6-a7d7-20c8f6c9bb15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:30.966231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e267e6fa-4616-46c6-a7d7-20c8f6c9bb15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:30.966678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e267e6fa-4616-46c6-a7d7-20c8f6c9bb15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:31.028535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e267e6fa-4616-46c6-a7d7-20c8f6c9bb15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:31.035970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e267e6fa-4616-46c6-a7d7-20c8f6c9bb15 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081840 Jun 20 06:29:31.036534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 720/1443] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:30 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:31.367932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d90b7325-f0ac-4771-924b-764b53f5020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:31.368543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d90b7325-f0ac-4771-924b-764b53f5020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:31.376156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d90b7325-f0ac-4771-924b-764b53f5020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:31.376599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d90b7325-f0ac-4771-924b-764b53f5020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:31.377353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d90b7325-f0ac-4771-924b-764b53f5020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:31.377808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d90b7325-f0ac-4771-924b-764b53f5020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:31.505313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d90b7325-f0ac-4771-924b-764b53f5020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:31.512812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d90b7325-f0ac-4771-924b-764b53f5020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148668 Jun 20 06:29:31.513401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 724/1444] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:31 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:32.052513 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b6443dd0-76b9-471e-8843-00b9208a60ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:32.053127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b6443dd0-76b9-471e-8843-00b9208a60ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:32.059803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6443dd0-76b9-471e-8843-00b9208a60ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:32.060250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6443dd0-76b9-471e-8843-00b9208a60ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:32.061057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6443dd0-76b9-471e-8843-00b9208a60ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:32.061608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6443dd0-76b9-471e-8843-00b9208a60ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:32.123758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b6443dd0-76b9-471e-8843-00b9208a60ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:32.131322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b6443dd0-76b9-471e-8843-00b9208a60ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.082658 Jun 20 06:29:32.131886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 721/1445] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:32 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:32.531415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58bcddf6-cb1d-4bfc-af7c-eea30463c1ba tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:32.532024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-58bcddf6-cb1d-4bfc-af7c-eea30463c1ba tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:32.538473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58bcddf6-cb1d-4bfc-af7c-eea30463c1ba tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:32.538911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58bcddf6-cb1d-4bfc-af7c-eea30463c1ba tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:32.539658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58bcddf6-cb1d-4bfc-af7c-eea30463c1ba tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:32.540085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58bcddf6-cb1d-4bfc-af7c-eea30463c1ba tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:32.668965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-58bcddf6-cb1d-4bfc-af7c-eea30463c1ba tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:32.676924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-58bcddf6-cb1d-4bfc-af7c-eea30463c1ba tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149374 Jun 20 06:29:32.677601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 725/1446] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:32 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:33.147971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-59da5be7-adb8-4035-9ceb-da98e2ae811c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:33.148569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-59da5be7-adb8-4035-9ceb-da98e2ae811c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:33.155603 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59da5be7-adb8-4035-9ceb-da98e2ae811c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:33.156117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59da5be7-adb8-4035-9ceb-da98e2ae811c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:33.156878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59da5be7-adb8-4035-9ceb-da98e2ae811c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:33.157314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-59da5be7-adb8-4035-9ceb-da98e2ae811c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:33.217931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-59da5be7-adb8-4035-9ceb-da98e2ae811c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:33.225316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-59da5be7-adb8-4035-9ceb-da98e2ae811c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081146 Jun 20 06:29:33.225905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 722/1447] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:33 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:33.694930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a64c936-1c9f-464a-b9e4-d1675a50effb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:33.695537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8a64c936-1c9f-464a-b9e4-d1675a50effb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:33.702186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a64c936-1c9f-464a-b9e4-d1675a50effb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:33.702623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a64c936-1c9f-464a-b9e4-d1675a50effb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:33.703362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a64c936-1c9f-464a-b9e4-d1675a50effb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:33.703788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a64c936-1c9f-464a-b9e4-d1675a50effb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:33.833249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a64c936-1c9f-464a-b9e4-d1675a50effb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:33.840740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a64c936-1c9f-464a-b9e4-d1675a50effb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149743 Jun 20 06:29:33.841302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 726/1448] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:33 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:34.242343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f8388314-719b-4f55-92b8-2c13c8dc9ef3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:34.242933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f8388314-719b-4f55-92b8-2c13c8dc9ef3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:34.249998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8388314-719b-4f55-92b8-2c13c8dc9ef3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:34.250442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8388314-719b-4f55-92b8-2c13c8dc9ef3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:34.251199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8388314-719b-4f55-92b8-2c13c8dc9ef3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:34.251625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8388314-719b-4f55-92b8-2c13c8dc9ef3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:34.311586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f8388314-719b-4f55-92b8-2c13c8dc9ef3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:34.319144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f8388314-719b-4f55-92b8-2c13c8dc9ef3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.080552 Jun 20 06:29:34.319702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 723/1449] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:34 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:34.858265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a76900f3-36f4-48b7-bd1b-d159daa729ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:34.858975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a76900f3-36f4-48b7-bd1b-d159daa729ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:34.865285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a76900f3-36f4-48b7-bd1b-d159daa729ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:34.865762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a76900f3-36f4-48b7-bd1b-d159daa729ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:34.866543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a76900f3-36f4-48b7-bd1b-d159daa729ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:34.866977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a76900f3-36f4-48b7-bd1b-d159daa729ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:34.995238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a76900f3-36f4-48b7-bd1b-d159daa729ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:35.003149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a76900f3-36f4-48b7-bd1b-d159daa729ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149856 Jun 20 06:29:35.003718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 727/1450] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:35.335964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-df7f505c-63dd-497e-91b0-543fe51b08e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:35.336579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-df7f505c-63dd-497e-91b0-543fe51b08e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:35.343203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df7f505c-63dd-497e-91b0-543fe51b08e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:35.343661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df7f505c-63dd-497e-91b0-543fe51b08e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:35.344430 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df7f505c-63dd-497e-91b0-543fe51b08e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:35.344868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df7f505c-63dd-497e-91b0-543fe51b08e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:35.407823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-df7f505c-63dd-497e-91b0-543fe51b08e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:35.415336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-df7f505c-63dd-497e-91b0-543fe51b08e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083186 Jun 20 06:29:35.415906 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 724/1451] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:35 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:36.020439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1c919768-9ed5-43ab-920e-de562b5d6b4a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:36.021051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1c919768-9ed5-43ab-920e-de562b5d6b4a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:36.027574 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c919768-9ed5-43ab-920e-de562b5d6b4a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:36.028021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c919768-9ed5-43ab-920e-de562b5d6b4a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:36.028779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c919768-9ed5-43ab-920e-de562b5d6b4a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:36.029247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c919768-9ed5-43ab-920e-de562b5d6b4a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:36.157061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c919768-9ed5-43ab-920e-de562b5d6b4a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:36.164512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1c919768-9ed5-43ab-920e-de562b5d6b4a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148196 Jun 20 06:29:36.165071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 728/1452] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:36.432141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-11a1d60e-03e3-4ff0-b9e3-20b95685bce4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:36.432749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-11a1d60e-03e3-4ff0-b9e3-20b95685bce4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:36.439264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11a1d60e-03e3-4ff0-b9e3-20b95685bce4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:36.439717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11a1d60e-03e3-4ff0-b9e3-20b95685bce4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:36.440481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11a1d60e-03e3-4ff0-b9e3-20b95685bce4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:36.440917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11a1d60e-03e3-4ff0-b9e3-20b95685bce4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:36.500765 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-11a1d60e-03e3-4ff0-b9e3-20b95685bce4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:36.508213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-11a1d60e-03e3-4ff0-b9e3-20b95685bce4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.079974 Jun 20 06:29:36.508777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 725/1453] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:36 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:37.181715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-92253738-a830-4999-b902-0560169c9d36 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:37.182328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-92253738-a830-4999-b902-0560169c9d36 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:37.189261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92253738-a830-4999-b902-0560169c9d36 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:37.189730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92253738-a830-4999-b902-0560169c9d36 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:37.190482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92253738-a830-4999-b902-0560169c9d36 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:37.190911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92253738-a830-4999-b902-0560169c9d36 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:37.320969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-92253738-a830-4999-b902-0560169c9d36 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:37.328565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-92253738-a830-4999-b902-0560169c9d36 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150637 Jun 20 06:29:37.329129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 729/1454] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:37.525802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dca22dc2-f7f4-4805-821b-6ddc4a6297bd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:37.526324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dca22dc2-f7f4-4805-821b-6ddc4a6297bd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:37.533575 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dca22dc2-f7f4-4805-821b-6ddc4a6297bd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:37.534031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dca22dc2-f7f4-4805-821b-6ddc4a6297bd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:37.534792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dca22dc2-f7f4-4805-821b-6ddc4a6297bd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:37.535232 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dca22dc2-f7f4-4805-821b-6ddc4a6297bd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:37.594389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dca22dc2-f7f4-4805-821b-6ddc4a6297bd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:37.601696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dca22dc2-f7f4-4805-821b-6ddc4a6297bd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.079736 Jun 20 06:29:37.602284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 726/1455] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:37 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:38.345890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b3a2cd09-b1b5-4e1b-9e9f-e4297e3fc309 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:38.346503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b3a2cd09-b1b5-4e1b-9e9f-e4297e3fc309 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:38.352923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3a2cd09-b1b5-4e1b-9e9f-e4297e3fc309 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:38.353370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3a2cd09-b1b5-4e1b-9e9f-e4297e3fc309 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:38.354152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3a2cd09-b1b5-4e1b-9e9f-e4297e3fc309 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:38.354587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3a2cd09-b1b5-4e1b-9e9f-e4297e3fc309 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:38.485510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b3a2cd09-b1b5-4e1b-9e9f-e4297e3fc309 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:38.492909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b3a2cd09-b1b5-4e1b-9e9f-e4297e3fc309 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150936 Jun 20 06:29:38.493493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 730/1456] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:38 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:38.618749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d5250fb9-d24a-4963-b2a4-26bb78e3953c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:38.619291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d5250fb9-d24a-4963-b2a4-26bb78e3953c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:38.626380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5250fb9-d24a-4963-b2a4-26bb78e3953c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:38.626824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5250fb9-d24a-4963-b2a4-26bb78e3953c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:38.627581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5250fb9-d24a-4963-b2a4-26bb78e3953c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:38.628010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5250fb9-d24a-4963-b2a4-26bb78e3953c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:38.694341 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d5250fb9-d24a-4963-b2a4-26bb78e3953c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:38.702169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d5250fb9-d24a-4963-b2a4-26bb78e3953c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.087319 Jun 20 06:29:38.702726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 727/1457] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:38 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:39.510474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-26d5561f-d3ee-406b-ac39-eeedfa078271 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:39.511117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-26d5561f-d3ee-406b-ac39-eeedfa078271 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:39.519095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26d5561f-d3ee-406b-ac39-eeedfa078271 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:39.519545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26d5561f-d3ee-406b-ac39-eeedfa078271 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:39.520306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26d5561f-d3ee-406b-ac39-eeedfa078271 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:39.520740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26d5561f-d3ee-406b-ac39-eeedfa078271 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:39.719602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f28aaf8-2b13-4f8b-8ee5-2d67667cef45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:39.720207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f28aaf8-2b13-4f8b-8ee5-2d67667cef45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:39.727152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f28aaf8-2b13-4f8b-8ee5-2d67667cef45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:39.727611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f28aaf8-2b13-4f8b-8ee5-2d67667cef45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:39.728405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f28aaf8-2b13-4f8b-8ee5-2d67667cef45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:39.728851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f28aaf8-2b13-4f8b-8ee5-2d67667cef45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:39.851690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f28aaf8-2b13-4f8b-8ee5-2d67667cef45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:39.859400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f28aaf8-2b13-4f8b-8ee5-2d67667cef45 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.144267 Jun 20 06:29:39.859972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 728/1458] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:39 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:39.910951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-26d5561f-d3ee-406b-ac39-eeedfa078271 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:39.918418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-26d5561f-d3ee-406b-ac39-eeedfa078271 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.411789 Jun 20 06:29:39.918988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 731/1459] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:39 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:40.876695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3c891329-b786-4cd0-86cf-e168dee18e43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:40.877295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3c891329-b786-4cd0-86cf-e168dee18e43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:40.883777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c891329-b786-4cd0-86cf-e168dee18e43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:40.884228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c891329-b786-4cd0-86cf-e168dee18e43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:40.884989 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c891329-b786-4cd0-86cf-e168dee18e43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:40.885459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c891329-b786-4cd0-86cf-e168dee18e43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:40.935480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6ed60991-86f3-4445-a5ea-27bc4ebde853 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:40.936239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6ed60991-86f3-4445-a5ea-27bc4ebde853 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:40.942739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ed60991-86f3-4445-a5ea-27bc4ebde853 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:40.943188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ed60991-86f3-4445-a5ea-27bc4ebde853 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:40.943945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ed60991-86f3-4445-a5ea-27bc4ebde853 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:40.944379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ed60991-86f3-4445-a5ea-27bc4ebde853 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:40.948902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3c891329-b786-4cd0-86cf-e168dee18e43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:40.957223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3c891329-b786-4cd0-86cf-e168dee18e43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.084956 Jun 20 06:29:40.957882 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 729/1460] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:40 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:41.073476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6ed60991-86f3-4445-a5ea-27bc4ebde853 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:41.081595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6ed60991-86f3-4445-a5ea-27bc4ebde853 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149927 Jun 20 06:29:41.082154 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 732/1461] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:41.973582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3a1c049a-c1d5-4d1a-806e-4232b4ac67ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:41.974184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3a1c049a-c1d5-4d1a-806e-4232b4ac67ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:41.980618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a1c049a-c1d5-4d1a-806e-4232b4ac67ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:41.981065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a1c049a-c1d5-4d1a-806e-4232b4ac67ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:41.981852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a1c049a-c1d5-4d1a-806e-4232b4ac67ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:41.982288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a1c049a-c1d5-4d1a-806e-4232b4ac67ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:42.047586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3a1c049a-c1d5-4d1a-806e-4232b4ac67ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:42.056311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3a1c049a-c1d5-4d1a-806e-4232b4ac67ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.085642 Jun 20 06:29:42.057128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 730/1462] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:41 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:42.098467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6a57b5c2-4521-498e-b09e-2ae44d70bc20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:42.099083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6a57b5c2-4521-498e-b09e-2ae44d70bc20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:42.105738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a57b5c2-4521-498e-b09e-2ae44d70bc20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:42.106188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a57b5c2-4521-498e-b09e-2ae44d70bc20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:42.106981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a57b5c2-4521-498e-b09e-2ae44d70bc20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:42.107423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a57b5c2-4521-498e-b09e-2ae44d70bc20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:42.239120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6a57b5c2-4521-498e-b09e-2ae44d70bc20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:42.246490 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6a57b5c2-4521-498e-b09e-2ae44d70bc20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151871 Jun 20 06:29:42.247045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 733/1463] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:42 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:43.072366 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b2f78c53-cebe-460e-9ef7-6a0611fdbcdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:43.073003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b2f78c53-cebe-460e-9ef7-6a0611fdbcdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:43.080138 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2f78c53-cebe-460e-9ef7-6a0611fdbcdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:43.080585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2f78c53-cebe-460e-9ef7-6a0611fdbcdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:43.081340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2f78c53-cebe-460e-9ef7-6a0611fdbcdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:43.081804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2f78c53-cebe-460e-9ef7-6a0611fdbcdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:43.142174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b2f78c53-cebe-460e-9ef7-6a0611fdbcdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:43.149620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b2f78c53-cebe-460e-9ef7-6a0611fdbcdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081187 Jun 20 06:29:43.150172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 731/1464] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:43 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:43.263531 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bec4aec7-40f7-4f81-b83a-56d906e4238f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:43.264142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bec4aec7-40f7-4f81-b83a-56d906e4238f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:43.267462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:43.272683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bec4aec7-40f7-4f81-b83a-56d906e4238f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:43.276881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bec4aec7-40f7-4f81-b83a-56d906e4238f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:43.278859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bec4aec7-40f7-4f81-b83a-56d906e4238f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:43.279303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bec4aec7-40f7-4f81-b83a-56d906e4238f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:43.408223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bec4aec7-40f7-4f81-b83a-56d906e4238f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:43.415667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bec4aec7-40f7-4f81-b83a-56d906e4238f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156014 Jun 20 06:29:43.416246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 734/1465] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:44.167091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eeb75efe-b966-48e2-afca-debd1698a1e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:44.167695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eeb75efe-b966-48e2-afca-debd1698a1e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:44.174837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eeb75efe-b966-48e2-afca-debd1698a1e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:44.175277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eeb75efe-b966-48e2-afca-debd1698a1e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:44.176033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eeb75efe-b966-48e2-afca-debd1698a1e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:44.176463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eeb75efe-b966-48e2-afca-debd1698a1e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:44.239129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eeb75efe-b966-48e2-afca-debd1698a1e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:44.246470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eeb75efe-b966-48e2-afca-debd1698a1e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.083374 Jun 20 06:29:44.247026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 732/1466] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:44 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:44.432769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2f61011b-1460-471a-910e-e1228b740c8e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:44.433306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2f61011b-1460-471a-910e-e1228b740c8e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:44.439844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f61011b-1460-471a-910e-e1228b740c8e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:44.440288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f61011b-1460-471a-910e-e1228b740c8e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:44.441044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f61011b-1460-471a-910e-e1228b740c8e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:44.441521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f61011b-1460-471a-910e-e1228b740c8e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:44.571784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2f61011b-1460-471a-910e-e1228b740c8e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:44.579298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2f61011b-1460-471a-910e-e1228b740c8e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150450 Jun 20 06:29:44.579860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 735/1467] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:45.263454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-692a3679-7fc9-4d0e-b02b-ccfc79085391 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:45.264071 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-692a3679-7fc9-4d0e-b02b-ccfc79085391 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:45.270446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-692a3679-7fc9-4d0e-b02b-ccfc79085391 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:45.270901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-692a3679-7fc9-4d0e-b02b-ccfc79085391 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:45.271664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-692a3679-7fc9-4d0e-b02b-ccfc79085391 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:45.272103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-692a3679-7fc9-4d0e-b02b-ccfc79085391 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:45.348039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-692a3679-7fc9-4d0e-b02b-ccfc79085391 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:45.355606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-692a3679-7fc9-4d0e-b02b-ccfc79085391 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.096154 Jun 20 06:29:45.356170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 733/1468] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:45 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:45.596147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fec6f942-aec5-4e93-860b-605feabcff8c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:45.596707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fec6f942-aec5-4e93-860b-605feabcff8c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:45.603277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fec6f942-aec5-4e93-860b-605feabcff8c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:45.603728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fec6f942-aec5-4e93-860b-605feabcff8c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:45.604493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fec6f942-aec5-4e93-860b-605feabcff8c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:45.604929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fec6f942-aec5-4e93-860b-605feabcff8c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:45.734576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fec6f942-aec5-4e93-860b-605feabcff8c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:45.742123 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fec6f942-aec5-4e93-860b-605feabcff8c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150008 Jun 20 06:29:45.742687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 736/1469] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:46.373226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e972363a-a409-4741-ab42-131ecbe7818a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:46.374048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e972363a-a409-4741-ab42-131ecbe7818a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:46.376441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:46.381798 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e972363a-a409-4741-ab42-131ecbe7818a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:46.382248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e972363a-a409-4741-ab42-131ecbe7818a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:46.383008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e972363a-a409-4741-ab42-131ecbe7818a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:46.383442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e972363a-a409-4741-ab42-131ecbe7818a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:46.601058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e972363a-a409-4741-ab42-131ecbe7818a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:46.608566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e972363a-a409-4741-ab42-131ecbe7818a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.239067 Jun 20 06:29:46.609038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 734/1470] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:46 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:46.759618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d2e28963-4dd7-4368-96aa-ed65ccc8df27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:46.760229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d2e28963-4dd7-4368-96aa-ed65ccc8df27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:46.767758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2e28963-4dd7-4368-96aa-ed65ccc8df27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:46.768206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2e28963-4dd7-4368-96aa-ed65ccc8df27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:46.768990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2e28963-4dd7-4368-96aa-ed65ccc8df27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:46.769448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2e28963-4dd7-4368-96aa-ed65ccc8df27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:46.899134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d2e28963-4dd7-4368-96aa-ed65ccc8df27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:46.901392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:46.907809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d2e28963-4dd7-4368-96aa-ed65ccc8df27 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152005 Jun 20 06:29:46.908383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 737/1471] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:47.625842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ae8ce1e9-a5ca-4133-a0ac-4c6c756552cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:47.626402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ae8ce1e9-a5ca-4133-a0ac-4c6c756552cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:47.632826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1e9-a5ca-4133-a0ac-4c6c756552cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:47.633270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1e9-a5ca-4133-a0ac-4c6c756552cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:47.634081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1e9-a5ca-4133-a0ac-4c6c756552cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:47.634508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae8ce1e9-a5ca-4133-a0ac-4c6c756552cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:47.698783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ae8ce1e9-a5ca-4133-a0ac-4c6c756552cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:47.707669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ae8ce1e9-a5ca-4133-a0ac-4c6c756552cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.086039 Jun 20 06:29:47.708217 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 735/1472] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:47 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:47.924827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b4130a63-a1ca-4797-86d7-5a80bac57205 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:47.925459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b4130a63-a1ca-4797-86d7-5a80bac57205 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:47.931950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4130a63-a1ca-4797-86d7-5a80bac57205 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:47.932385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4130a63-a1ca-4797-86d7-5a80bac57205 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:47.933132 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4130a63-a1ca-4797-86d7-5a80bac57205 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:47.933598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4130a63-a1ca-4797-86d7-5a80bac57205 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:48.064862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b4130a63-a1ca-4797-86d7-5a80bac57205 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:48.072239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b4130a63-a1ca-4797-86d7-5a80bac57205 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151341 Jun 20 06:29:48.072794 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 738/1473] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:48.724742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e594a074-4655-4daa-97ac-af663e1cb3fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:48.725343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e594a074-4655-4daa-97ac-af663e1cb3fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: cabdd9ee-515b-492e-82b7-aae14f44c6fb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:48.731841 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e594a074-4655-4daa-97ac-af663e1cb3fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:48.732285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e594a074-4655-4daa-97ac-af663e1cb3fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:48.733036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e594a074-4655-4daa-97ac-af663e1cb3fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:48.734172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e594a074-4655-4daa-97ac-af663e1cb3fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:48.738068 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:48.794813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e594a074-4655-4daa-97ac-af663e1cb3fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:48.802374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e594a074-4655-4daa-97ac-af663e1cb3fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb" status: 200 len: 1224 microversion: 2.1 time: 0.081399 Jun 20 06:29:48.802939 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 736/1474] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:48 2022] GET /compute/v2.1/servers/cabdd9ee-515b-492e-82b7-aae14f44c6fb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:49.089841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-430eb3bf-d4d2-430d-b0a3-afe60b4d3c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:49.090437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-430eb3bf-d4d2-430d-b0a3-afe60b4d3c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:49.097015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-430eb3bf-d4d2-430d-b0a3-afe60b4d3c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:49.097511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-430eb3bf-d4d2-430d-b0a3-afe60b4d3c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:49.098566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-430eb3bf-d4d2-430d-b0a3-afe60b4d3c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:49.098741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-430eb3bf-d4d2-430d-b0a3-afe60b4d3c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:49.232233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-430eb3bf-d4d2-430d-b0a3-afe60b4d3c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:49.240366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-430eb3bf-d4d2-430d-b0a3-afe60b4d3c30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154414 Jun 20 06:29:49.240935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 739/1475] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:50.258757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-518a0711-b206-4a80-acbc-53e81088d40d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:50.259364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-518a0711-b206-4a80-acbc-53e81088d40d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:50.266747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-518a0711-b206-4a80-acbc-53e81088d40d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:50.267190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-518a0711-b206-4a80-acbc-53e81088d40d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:50.267993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-518a0711-b206-4a80-acbc-53e81088d40d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:50.268423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-518a0711-b206-4a80-acbc-53e81088d40d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:50.397981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-518a0711-b206-4a80-acbc-53e81088d40d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:50.405624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-518a0711-b206-4a80-acbc-53e81088d40d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150662 Jun 20 06:29:50.406094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 737/1476] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:51.422608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cd459b2a-ddaa-465d-bc6a-483647c8506a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:51.423213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cd459b2a-ddaa-465d-bc6a-483647c8506a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:51.429797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd459b2a-ddaa-465d-bc6a-483647c8506a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:51.430235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd459b2a-ddaa-465d-bc6a-483647c8506a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:51.430988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd459b2a-ddaa-465d-bc6a-483647c8506a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:51.431420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd459b2a-ddaa-465d-bc6a-483647c8506a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:51.561903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cd459b2a-ddaa-465d-bc6a-483647c8506a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:51.569255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cd459b2a-ddaa-465d-bc6a-483647c8506a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150775 Jun 20 06:29:51.569833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 740/1477] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:52.586548 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2174c4d2-a1eb-44d0-9a10-1086ac00106d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:52.587091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2174c4d2-a1eb-44d0-9a10-1086ac00106d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:52.593546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2174c4d2-a1eb-44d0-9a10-1086ac00106d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:52.593993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2174c4d2-a1eb-44d0-9a10-1086ac00106d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:52.594783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2174c4d2-a1eb-44d0-9a10-1086ac00106d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:52.595210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2174c4d2-a1eb-44d0-9a10-1086ac00106d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:52.732741 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2174c4d2-a1eb-44d0-9a10-1086ac00106d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:52.741195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2174c4d2-a1eb-44d0-9a10-1086ac00106d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.158509 Jun 20 06:29:52.741783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 738/1478] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:53.759393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2b54aeb1-8b97-4830-b298-765467791c2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:53.760009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2b54aeb1-8b97-4830-b298-765467791c2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:53.767282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b54aeb1-8b97-4830-b298-765467791c2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:53.767732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b54aeb1-8b97-4830-b298-765467791c2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:53.768496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b54aeb1-8b97-4830-b298-765467791c2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:53.768932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b54aeb1-8b97-4830-b298-765467791c2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:53.895698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2b54aeb1-8b97-4830-b298-765467791c2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:53.903146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2b54aeb1-8b97-4830-b298-765467791c2e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147667 Jun 20 06:29:53.903707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 741/1479] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:53 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:54.920270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6b910980-48ec-4275-83c7-9a320015e6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:54.920802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6b910980-48ec-4275-83c7-9a320015e6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:54.927283 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b910980-48ec-4275-83c7-9a320015e6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:54.927732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b910980-48ec-4275-83c7-9a320015e6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:54.928485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b910980-48ec-4275-83c7-9a320015e6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:54.928913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b910980-48ec-4275-83c7-9a320015e6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:55.064508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6b910980-48ec-4275-83c7-9a320015e6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:55.072112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6b910980-48ec-4275-83c7-9a320015e6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.155792 Jun 20 06:29:55.072793 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 739/1480] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:56.090017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3e85c8f1-8cf2-4319-a223-2eac18eafed4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:56.090622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3e85c8f1-8cf2-4319-a223-2eac18eafed4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:56.097121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e85c8f1-8cf2-4319-a223-2eac18eafed4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:56.097600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e85c8f1-8cf2-4319-a223-2eac18eafed4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:56.098363 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e85c8f1-8cf2-4319-a223-2eac18eafed4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:56.098792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e85c8f1-8cf2-4319-a223-2eac18eafed4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:56.226567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3e85c8f1-8cf2-4319-a223-2eac18eafed4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:56.233885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3e85c8f1-8cf2-4319-a223-2eac18eafed4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147712 Jun 20 06:29:56.234439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 742/1481] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:57.251558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-210956fa-8d52-4307-b7b0-32febeec7295 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:57.252171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-210956fa-8d52-4307-b7b0-32febeec7295 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:57.258698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-210956fa-8d52-4307-b7b0-32febeec7295 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:57.259148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-210956fa-8d52-4307-b7b0-32febeec7295 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:57.259911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-210956fa-8d52-4307-b7b0-32febeec7295 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:57.260348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-210956fa-8d52-4307-b7b0-32febeec7295 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:57.396715 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-210956fa-8d52-4307-b7b0-32febeec7295 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:57.404239 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-210956fa-8d52-4307-b7b0-32febeec7295 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156662 Jun 20 06:29:57.404807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 740/1482] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:29:58.310590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:29:58.311081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:29:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:29:58.421264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c8a3af4c-bc26-4a86-8880-af89710c3979 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:58.421921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c8a3af4c-bc26-4a86-8880-af89710c3979 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:58.429111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8a3af4c-bc26-4a86-8880-af89710c3979 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:58.429666 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8a3af4c-bc26-4a86-8880-af89710c3979 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:58.430419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8a3af4c-bc26-4a86-8880-af89710c3979 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:58.430845 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8a3af4c-bc26-4a86-8880-af89710c3979 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:58.562845 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c8a3af4c-bc26-4a86-8880-af89710c3979 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:58.570540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c8a3af4c-bc26-4a86-8880-af89710c3979 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153095 Jun 20 06:29:58.571095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 743/1483] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:29:59.588073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-08d61ef3-adec-4261-80ae-20205e3d3aa3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:29:59.588680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-08d61ef3-adec-4261-80ae-20205e3d3aa3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:29:59.595957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08d61ef3-adec-4261-80ae-20205e3d3aa3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:59.596404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08d61ef3-adec-4261-80ae-20205e3d3aa3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:59.597161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08d61ef3-adec-4261-80ae-20205e3d3aa3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:29:59.597634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-08d61ef3-adec-4261-80ae-20205e3d3aa3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:29:59.726153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-08d61ef3-adec-4261-80ae-20205e3d3aa3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:29:59.733617 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-08d61ef3-adec-4261-80ae-20205e3d3aa3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149339 Jun 20 06:29:59.734180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 741/1484] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:29:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:00.503749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:30:00.503966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:30:00.751574 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b5afc3be-a2eb-4907-9c46-9e70a17c403e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:00.752170 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b5afc3be-a2eb-4907-9c46-9e70a17c403e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:00.758842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5afc3be-a2eb-4907-9c46-9e70a17c403e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:00.759282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5afc3be-a2eb-4907-9c46-9e70a17c403e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:00.760030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5afc3be-a2eb-4907-9c46-9e70a17c403e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:00.760463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b5afc3be-a2eb-4907-9c46-9e70a17c403e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:00.896278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b5afc3be-a2eb-4907-9c46-9e70a17c403e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:00.903633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b5afc3be-a2eb-4907-9c46-9e70a17c403e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156615 Jun 20 06:30:00.904178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 744/1485] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:01.921412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a95886a-8273-43bf-951d-25b386a7b23b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:01.923006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a95886a-8273-43bf-951d-25b386a7b23b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:01.929232 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a95886a-8273-43bf-951d-25b386a7b23b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:01.929711 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a95886a-8273-43bf-951d-25b386a7b23b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:01.930494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a95886a-8273-43bf-951d-25b386a7b23b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:01.930931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a95886a-8273-43bf-951d-25b386a7b23b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:02.060140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a95886a-8273-43bf-951d-25b386a7b23b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:02.067785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a95886a-8273-43bf-951d-25b386a7b23b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150264 Jun 20 06:30:02.068557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 742/1486] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:03.084570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-da838617-ea30-4c9c-9a46-63fdf72fd971 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:03.085199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-da838617-ea30-4c9c-9a46-63fdf72fd971 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:03.091324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da838617-ea30-4c9c-9a46-63fdf72fd971 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:03.091765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da838617-ea30-4c9c-9a46-63fdf72fd971 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:03.092509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da838617-ea30-4c9c-9a46-63fdf72fd971 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:03.092936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-da838617-ea30-4c9c-9a46-63fdf72fd971 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:03.224044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-da838617-ea30-4c9c-9a46-63fdf72fd971 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:03.231360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-da838617-ea30-4c9c-9a46-63fdf72fd971 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150761 Jun 20 06:30:03.231911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 745/1487] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:04.248972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-03389520-2e13-4569-a566-c7d98b3be150 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:04.249618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-03389520-2e13-4569-a566-c7d98b3be150 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:04.256838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03389520-2e13-4569-a566-c7d98b3be150 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:04.257290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03389520-2e13-4569-a566-c7d98b3be150 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:04.258085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03389520-2e13-4569-a566-c7d98b3be150 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:04.258516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03389520-2e13-4569-a566-c7d98b3be150 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:04.387020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-03389520-2e13-4569-a566-c7d98b3be150 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:04.395317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-03389520-2e13-4569-a566-c7d98b3be150 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150215 Jun 20 06:30:04.395913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 743/1488] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:05.412206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a87c91c3-da2a-4f38-885a-fcefb7545d49 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:05.412822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a87c91c3-da2a-4f38-885a-fcefb7545d49 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:05.419329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a87c91c3-da2a-4f38-885a-fcefb7545d49 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:05.419786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a87c91c3-da2a-4f38-885a-fcefb7545d49 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:05.420546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a87c91c3-da2a-4f38-885a-fcefb7545d49 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:05.420981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a87c91c3-da2a-4f38-885a-fcefb7545d49 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:05.551389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a87c91c3-da2a-4f38-885a-fcefb7545d49 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:05.558884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a87c91c3-da2a-4f38-885a-fcefb7545d49 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150568 Jun 20 06:30:05.559453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 746/1489] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:06.575919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-45c12059-c2f5-43b4-9df1-a4d676dbbfa1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:06.577273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-45c12059-c2f5-43b4-9df1-a4d676dbbfa1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:06.584632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45c12059-c2f5-43b4-9df1-a4d676dbbfa1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:06.585115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45c12059-c2f5-43b4-9df1-a4d676dbbfa1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:06.585910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45c12059-c2f5-43b4-9df1-a4d676dbbfa1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:06.586347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45c12059-c2f5-43b4-9df1-a4d676dbbfa1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:06.720268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-45c12059-c2f5-43b4-9df1-a4d676dbbfa1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:06.727898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-45c12059-c2f5-43b4-9df1-a4d676dbbfa1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.155770 Jun 20 06:30:06.728477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 744/1490] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:07.746536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-084f6360-0574-4997-9e71-a5f7d5b8774c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:07.747150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-084f6360-0574-4997-9e71-a5f7d5b8774c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:07.754191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-084f6360-0574-4997-9e71-a5f7d5b8774c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:07.754642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-084f6360-0574-4997-9e71-a5f7d5b8774c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:07.755399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-084f6360-0574-4997-9e71-a5f7d5b8774c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:07.755832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-084f6360-0574-4997-9e71-a5f7d5b8774c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:07.882438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-084f6360-0574-4997-9e71-a5f7d5b8774c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:07.889772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-084f6360-0574-4997-9e71-a5f7d5b8774c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147109 Jun 20 06:30:07.890335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 747/1491] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:08.745172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0a25848-36e9-4e23-bfd6-fd6c1348b26b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:08.745705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f0a25848-36e9-4e23-bfd6-fd6c1348b26b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:08.752489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0a25848-36e9-4e23-bfd6-fd6c1348b26b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:08.752932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0a25848-36e9-4e23-bfd6-fd6c1348b26b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:08.753710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0a25848-36e9-4e23-bfd6-fd6c1348b26b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:08.754140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0a25848-36e9-4e23-bfd6-fd6c1348b26b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:08.906176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-70a9b48a-8a1b-4024-a3e7-5c3f6ed16900 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:08.907065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-70a9b48a-8a1b-4024-a3e7-5c3f6ed16900 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:08.913288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70a9b48a-8a1b-4024-a3e7-5c3f6ed16900 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:08.913774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70a9b48a-8a1b-4024-a3e7-5c3f6ed16900 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:08.914536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70a9b48a-8a1b-4024-a3e7-5c3f6ed16900 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:08.914969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70a9b48a-8a1b-4024-a3e7-5c3f6ed16900 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:09.046134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-70a9b48a-8a1b-4024-a3e7-5c3f6ed16900 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:09.054163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-70a9b48a-8a1b-4024-a3e7-5c3f6ed16900 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151910 Jun 20 06:30:09.054720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 748/1492] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:10.071842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5fdbafa2-d8fa-4a99-b94f-0e4e23f1dfad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:10.072526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5fdbafa2-d8fa-4a99-b94f-0e4e23f1dfad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:10.079459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fdbafa2-d8fa-4a99-b94f-0e4e23f1dfad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:10.079899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fdbafa2-d8fa-4a99-b94f-0e4e23f1dfad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:10.080657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fdbafa2-d8fa-4a99-b94f-0e4e23f1dfad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:10.081084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fdbafa2-d8fa-4a99-b94f-0e4e23f1dfad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:10.210936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5fdbafa2-d8fa-4a99-b94f-0e4e23f1dfad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:10.218542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5fdbafa2-d8fa-4a99-b94f-0e4e23f1dfad tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150503 Jun 20 06:30:10.219110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 749/1493] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:10 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:11.236214 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-979d339d-dfc7-4077-b1f6-83e33dac96f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:11.236879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-979d339d-dfc7-4077-b1f6-83e33dac96f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:11.243232 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-979d339d-dfc7-4077-b1f6-83e33dac96f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:11.243671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-979d339d-dfc7-4077-b1f6-83e33dac96f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:11.244419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-979d339d-dfc7-4077-b1f6-83e33dac96f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:11.244874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-979d339d-dfc7-4077-b1f6-83e33dac96f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:11.384248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-979d339d-dfc7-4077-b1f6-83e33dac96f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:11.392716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-979d339d-dfc7-4077-b1f6-83e33dac96f4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.160910 Jun 20 06:30:11.393284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 750/1494] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:12.410378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-92e8990e-5436-41c0-b386-052b1b0587e8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:12.411014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-92e8990e-5436-41c0-b386-052b1b0587e8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:12.418923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92e8990e-5436-41c0-b386-052b1b0587e8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:12.419356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92e8990e-5436-41c0-b386-052b1b0587e8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:12.420109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92e8990e-5436-41c0-b386-052b1b0587e8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:12.420536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92e8990e-5436-41c0-b386-052b1b0587e8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:12.549200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-92e8990e-5436-41c0-b386-052b1b0587e8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:12.556656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-92e8990e-5436-41c0-b386-052b1b0587e8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150716 Jun 20 06:30:12.557292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 751/1495] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:13.573738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1a574114-6441-4583-ac91-e88616efd481 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:13.574437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1a574114-6441-4583-ac91-e88616efd481 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:13.576714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=36 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:13.582731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a574114-6441-4583-ac91-e88616efd481 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:13.583124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a574114-6441-4583-ac91-e88616efd481 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:13.583890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a574114-6441-4583-ac91-e88616efd481 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:13.584320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a574114-6441-4583-ac91-e88616efd481 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:13.716223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1a574114-6441-4583-ac91-e88616efd481 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:13.723773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1a574114-6441-4583-ac91-e88616efd481 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153852 Jun 20 06:30:13.724325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 752/1496] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:14.740976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5fab272a-a4e1-4399-a479-f8b7c5cb3a5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:14.741690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5fab272a-a4e1-4399-a479-f8b7c5cb3a5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:14.747944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fab272a-a4e1-4399-a479-f8b7c5cb3a5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:14.748445 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fab272a-a4e1-4399-a479-f8b7c5cb3a5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:14.749193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fab272a-a4e1-4399-a479-f8b7c5cb3a5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:14.750188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5fab272a-a4e1-4399-a479-f8b7c5cb3a5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:14.887860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5fab272a-a4e1-4399-a479-f8b7c5cb3a5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:14.896173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5fab272a-a4e1-4399-a479-f8b7c5cb3a5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.159108 Jun 20 06:30:14.896725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 753/1497] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:15.913112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d5b5cf19-26ba-45ef-9494-054a885b98d4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:15.913805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d5b5cf19-26ba-45ef-9494-054a885b98d4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:15.920255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5b5cf19-26ba-45ef-9494-054a885b98d4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:15.920707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5b5cf19-26ba-45ef-9494-054a885b98d4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:15.922017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5b5cf19-26ba-45ef-9494-054a885b98d4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:15.922498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5b5cf19-26ba-45ef-9494-054a885b98d4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:15.937855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:16.051735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d5b5cf19-26ba-45ef-9494-054a885b98d4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:16.059284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d5b5cf19-26ba-45ef-9494-054a885b98d4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150037 Jun 20 06:30:16.059837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 754/1498] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:15 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:17.077007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-20fbd0c4-800f-42e9-86e1-c8f8617cc6ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:17.078349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-20fbd0c4-800f-42e9-86e1-c8f8617cc6ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:17.091373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-20fbd0c4-800f-42e9-86e1-c8f8617cc6ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:17.091813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-20fbd0c4-800f-42e9-86e1-c8f8617cc6ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:17.092574 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-20fbd0c4-800f-42e9-86e1-c8f8617cc6ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:17.093002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-20fbd0c4-800f-42e9-86e1-c8f8617cc6ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:17.226732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-20fbd0c4-800f-42e9-86e1-c8f8617cc6ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:17.236184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-20fbd0c4-800f-42e9-86e1-c8f8617cc6ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.162862 Jun 20 06:30:17.236765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 755/1499] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:17 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:18.253736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-527e1630-19b9-4cd0-99c2-2d03966244bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:18.254382 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-527e1630-19b9-4cd0-99c2-2d03966244bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:18.260714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-527e1630-19b9-4cd0-99c2-2d03966244bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:18.261151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-527e1630-19b9-4cd0-99c2-2d03966244bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:18.261938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-527e1630-19b9-4cd0-99c2-2d03966244bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:18.262367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-527e1630-19b9-4cd0-99c2-2d03966244bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:18.393677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-527e1630-19b9-4cd0-99c2-2d03966244bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:18.401046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-527e1630-19b9-4cd0-99c2-2d03966244bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151618 Jun 20 06:30:18.401638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 756/1500] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:18.750517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=23 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:18.772724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=57 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:19.418321 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6a04d5a7-0398-4ac0-b671-6ede98ed5d6d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:19.418935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6a04d5a7-0398-4ac0-b671-6ede98ed5d6d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:19.426190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a04d5a7-0398-4ac0-b671-6ede98ed5d6d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:19.426634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a04d5a7-0398-4ac0-b671-6ede98ed5d6d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:19.427399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a04d5a7-0398-4ac0-b671-6ede98ed5d6d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:19.427831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a04d5a7-0398-4ac0-b671-6ede98ed5d6d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:19.556898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6a04d5a7-0398-4ac0-b671-6ede98ed5d6d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:19.564794 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6a04d5a7-0398-4ac0-b671-6ede98ed5d6d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150394 Jun 20 06:30:19.565361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 757/1501] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:20.582579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-85cda8c8-bbfd-4faf-b54b-6eae7059ac86 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:20.583210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-85cda8c8-bbfd-4faf-b54b-6eae7059ac86 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:20.590385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85cda8c8-bbfd-4faf-b54b-6eae7059ac86 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:20.591018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85cda8c8-bbfd-4faf-b54b-6eae7059ac86 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:20.592383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85cda8c8-bbfd-4faf-b54b-6eae7059ac86 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:20.593223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85cda8c8-bbfd-4faf-b54b-6eae7059ac86 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:20.745014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-85cda8c8-bbfd-4faf-b54b-6eae7059ac86 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:20.755455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-85cda8c8-bbfd-4faf-b54b-6eae7059ac86 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.176724 Jun 20 06:30:20.756030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 758/1502] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:21.774027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-19e32ab6-4352-448f-8eda-0db44f1ce323 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:21.774685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-19e32ab6-4352-448f-8eda-0db44f1ce323 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:21.781306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19e32ab6-4352-448f-8eda-0db44f1ce323 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:21.781803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19e32ab6-4352-448f-8eda-0db44f1ce323 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:21.782564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19e32ab6-4352-448f-8eda-0db44f1ce323 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:21.782996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19e32ab6-4352-448f-8eda-0db44f1ce323 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:21.918612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-19e32ab6-4352-448f-8eda-0db44f1ce323 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:21.926887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-19e32ab6-4352-448f-8eda-0db44f1ce323 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156800 Jun 20 06:30:21.927444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 759/1503] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:22.944190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cfdc36f7-2d68-49c6-aa75-ea395307988c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:22.944839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cfdc36f7-2d68-49c6-aa75-ea395307988c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:22.951218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfdc36f7-2d68-49c6-aa75-ea395307988c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:22.951658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfdc36f7-2d68-49c6-aa75-ea395307988c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:22.952407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfdc36f7-2d68-49c6-aa75-ea395307988c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:22.953596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfdc36f7-2d68-49c6-aa75-ea395307988c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:23.084000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cfdc36f7-2d68-49c6-aa75-ea395307988c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:23.091415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cfdc36f7-2d68-49c6-aa75-ea395307988c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151071 Jun 20 06:30:23.091969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 760/1504] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:22 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:24.108118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1c282b77-87a1-4b11-8ab9-b78e6ffdeec7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:24.108772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1c282b77-87a1-4b11-8ab9-b78e6ffdeec7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:24.115380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c282b77-87a1-4b11-8ab9-b78e6ffdeec7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:24.115820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c282b77-87a1-4b11-8ab9-b78e6ffdeec7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:24.116570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c282b77-87a1-4b11-8ab9-b78e6ffdeec7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:24.116999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c282b77-87a1-4b11-8ab9-b78e6ffdeec7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:24.245734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c282b77-87a1-4b11-8ab9-b78e6ffdeec7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:24.253275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1c282b77-87a1-4b11-8ab9-b78e6ffdeec7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149094 Jun 20 06:30:24.254075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 761/1505] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:24 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:25.272016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-77169321-fe15-44c7-a2fb-142c7ca075de tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:25.272647 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-77169321-fe15-44c7-a2fb-142c7ca075de tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:25.279114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-77169321-fe15-44c7-a2fb-142c7ca075de tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:25.279565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-77169321-fe15-44c7-a2fb-142c7ca075de tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:25.280320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-77169321-fe15-44c7-a2fb-142c7ca075de tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:25.280774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-77169321-fe15-44c7-a2fb-142c7ca075de tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:25.415962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-77169321-fe15-44c7-a2fb-142c7ca075de tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:25.423605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-77169321-fe15-44c7-a2fb-142c7ca075de tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.155487 Jun 20 06:30:25.424169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 762/1506] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:25 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:26.440260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9117d1a0-8102-45fd-8816-a2c60747f872 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:26.440877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9117d1a0-8102-45fd-8816-a2c60747f872 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:26.447315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9117d1a0-8102-45fd-8816-a2c60747f872 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:26.447767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9117d1a0-8102-45fd-8816-a2c60747f872 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:26.448532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9117d1a0-8102-45fd-8816-a2c60747f872 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:26.448968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9117d1a0-8102-45fd-8816-a2c60747f872 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:26.578489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9117d1a0-8102-45fd-8816-a2c60747f872 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:26.586027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9117d1a0-8102-45fd-8816-a2c60747f872 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149651 Jun 20 06:30:26.586529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 763/1507] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:27.604023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-43b075bc-9b14-47d8-81e7-13b781bdcc78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:27.604635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-43b075bc-9b14-47d8-81e7-13b781bdcc78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:27.611676 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43b075bc-9b14-47d8-81e7-13b781bdcc78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:27.612126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43b075bc-9b14-47d8-81e7-13b781bdcc78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:27.612883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43b075bc-9b14-47d8-81e7-13b781bdcc78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:27.613319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43b075bc-9b14-47d8-81e7-13b781bdcc78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:27.742515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-43b075bc-9b14-47d8-81e7-13b781bdcc78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:27.750832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-43b075bc-9b14-47d8-81e7-13b781bdcc78 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150560 Jun 20 06:30:27.751396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 764/1508] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:27 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:28.768782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4431ac0c-6c16-4384-99af-b2886ed198b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:28.769475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4431ac0c-6c16-4384-99af-b2886ed198b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:28.776041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4431ac0c-6c16-4384-99af-b2886ed198b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:28.776496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4431ac0c-6c16-4384-99af-b2886ed198b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:28.777265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4431ac0c-6c16-4384-99af-b2886ed198b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:28.777732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4431ac0c-6c16-4384-99af-b2886ed198b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:28.915662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4431ac0c-6c16-4384-99af-b2886ed198b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:28.923712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4431ac0c-6c16-4384-99af-b2886ed198b4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.159391 Jun 20 06:30:28.924733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 765/1509] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:28 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:29.941121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fa392eae-cde5-4232-a5dc-47df3e89724d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:29.941796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fa392eae-cde5-4232-a5dc-47df3e89724d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:29.948077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa392eae-cde5-4232-a5dc-47df3e89724d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:29.948514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa392eae-cde5-4232-a5dc-47df3e89724d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:29.949259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa392eae-cde5-4232-a5dc-47df3e89724d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:29.949784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fa392eae-cde5-4232-a5dc-47df3e89724d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:30.077600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fa392eae-cde5-4232-a5dc-47df3e89724d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:30.086042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fa392eae-cde5-4232-a5dc-47df3e89724d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148597 Jun 20 06:30:30.086611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 766/1510] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:31.103764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4300af56-a8e4-4b30-9486-3b25439911a8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:31.104420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4300af56-a8e4-4b30-9486-3b25439911a8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:31.111673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4300af56-a8e4-4b30-9486-3b25439911a8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:31.112111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4300af56-a8e4-4b30-9486-3b25439911a8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:31.112866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4300af56-a8e4-4b30-9486-3b25439911a8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:31.113293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4300af56-a8e4-4b30-9486-3b25439911a8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:31.249023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4300af56-a8e4-4b30-9486-3b25439911a8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:31.257001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4300af56-a8e4-4b30-9486-3b25439911a8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157218 Jun 20 06:30:31.257589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 767/1511] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:31 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:32.274397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-271688ef-7fe4-4e5e-8304-f2164faad67c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:32.275025 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-271688ef-7fe4-4e5e-8304-f2164faad67c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:32.281641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-271688ef-7fe4-4e5e-8304-f2164faad67c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:32.282083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-271688ef-7fe4-4e5e-8304-f2164faad67c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:32.283012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-271688ef-7fe4-4e5e-8304-f2164faad67c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:32.283442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-271688ef-7fe4-4e5e-8304-f2164faad67c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:32.414626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-271688ef-7fe4-4e5e-8304-f2164faad67c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:32.423411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-271688ef-7fe4-4e5e-8304-f2164faad67c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152117 Jun 20 06:30:32.424086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 768/1512] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:32 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:33.440143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-61447dd8-d050-44e0-89db-7c05b6ab5a88 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:33.440788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-61447dd8-d050-44e0-89db-7c05b6ab5a88 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:33.447328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61447dd8-d050-44e0-89db-7c05b6ab5a88 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:33.447712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61447dd8-d050-44e0-89db-7c05b6ab5a88 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:33.448491 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61447dd8-d050-44e0-89db-7c05b6ab5a88 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:33.448926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-61447dd8-d050-44e0-89db-7c05b6ab5a88 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:33.585934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-61447dd8-d050-44e0-89db-7c05b6ab5a88 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:33.593693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-61447dd8-d050-44e0-89db-7c05b6ab5a88 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157332 Jun 20 06:30:33.594764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 769/1513] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:33 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:34.612754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8c82d952-17ae-4aae-bd71-fc08d70eebb9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:34.613348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8c82d952-17ae-4aae-bd71-fc08d70eebb9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:34.620030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c82d952-17ae-4aae-bd71-fc08d70eebb9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:34.620476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c82d952-17ae-4aae-bd71-fc08d70eebb9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:34.621243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c82d952-17ae-4aae-bd71-fc08d70eebb9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:34.621706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c82d952-17ae-4aae-bd71-fc08d70eebb9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:34.757762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8c82d952-17ae-4aae-bd71-fc08d70eebb9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:34.765339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8c82d952-17ae-4aae-bd71-fc08d70eebb9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157105 Jun 20 06:30:34.768300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 770/1514] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:35.783805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cd8788d6-5502-44b2-97a5-b600741a003f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:35.784455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cd8788d6-5502-44b2-97a5-b600741a003f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:35.790832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd8788d6-5502-44b2-97a5-b600741a003f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:35.791269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd8788d6-5502-44b2-97a5-b600741a003f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:35.792030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd8788d6-5502-44b2-97a5-b600741a003f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:35.792460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd8788d6-5502-44b2-97a5-b600741a003f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:35.794985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:35.931437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cd8788d6-5502-44b2-97a5-b600741a003f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:35.940646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cd8788d6-5502-44b2-97a5-b600741a003f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.160877 Jun 20 06:30:35.941219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 771/1515] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:35 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:36.958790 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-88b7da30-84e3-4a19-babf-3e03a7cb7e45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:36.960082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-88b7da30-84e3-4a19-babf-3e03a7cb7e45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:36.966763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88b7da30-84e3-4a19-babf-3e03a7cb7e45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:36.967221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88b7da30-84e3-4a19-babf-3e03a7cb7e45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:36.968018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88b7da30-84e3-4a19-babf-3e03a7cb7e45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:36.968438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88b7da30-84e3-4a19-babf-3e03a7cb7e45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:37.109227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-88b7da30-84e3-4a19-babf-3e03a7cb7e45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:37.117566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-88b7da30-84e3-4a19-babf-3e03a7cb7e45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.162591 Jun 20 06:30:37.118134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 772/1516] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:38.135428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-09bf873c-0cbc-4d89-b56e-396e416d161e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:38.136098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-09bf873c-0cbc-4d89-b56e-396e416d161e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:38.143127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09bf873c-0cbc-4d89-b56e-396e416d161e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:38.143565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09bf873c-0cbc-4d89-b56e-396e416d161e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:38.144318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09bf873c-0cbc-4d89-b56e-396e416d161e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:38.144745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09bf873c-0cbc-4d89-b56e-396e416d161e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:38.278763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-09bf873c-0cbc-4d89-b56e-396e416d161e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:38.286854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-09bf873c-0cbc-4d89-b56e-396e416d161e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.155305 Jun 20 06:30:38.287405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 773/1517] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:38 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:39.304278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6e85b5bd-38ab-45b9-9ac8-c74fb2cbcb60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:39.305006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6e85b5bd-38ab-45b9-9ac8-c74fb2cbcb60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:39.311472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e85b5bd-38ab-45b9-9ac8-c74fb2cbcb60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:39.311921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e85b5bd-38ab-45b9-9ac8-c74fb2cbcb60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:39.312684 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e85b5bd-38ab-45b9-9ac8-c74fb2cbcb60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:39.313710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e85b5bd-38ab-45b9-9ac8-c74fb2cbcb60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:39.447103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6e85b5bd-38ab-45b9-9ac8-c74fb2cbcb60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:39.454677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6e85b5bd-38ab-45b9-9ac8-c74fb2cbcb60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154277 Jun 20 06:30:39.455416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 774/1518] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:39 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:40.472296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-688aac8a-e56a-4a1b-a863-867dd8a08ee4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:40.472928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-688aac8a-e56a-4a1b-a863-867dd8a08ee4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:40.479435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-688aac8a-e56a-4a1b-a863-867dd8a08ee4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:40.479882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-688aac8a-e56a-4a1b-a863-867dd8a08ee4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:40.480639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-688aac8a-e56a-4a1b-a863-867dd8a08ee4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:40.481071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-688aac8a-e56a-4a1b-a863-867dd8a08ee4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:40.612403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-688aac8a-e56a-4a1b-a863-867dd8a08ee4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:40.619856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-688aac8a-e56a-4a1b-a863-867dd8a08ee4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151966 Jun 20 06:30:40.620416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 775/1519] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:41.637530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d31ad7a1-1c64-4fe1-8d06-809734461dbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:41.638177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d31ad7a1-1c64-4fe1-8d06-809734461dbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:41.644904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d31ad7a1-1c64-4fe1-8d06-809734461dbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:41.645348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d31ad7a1-1c64-4fe1-8d06-809734461dbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:41.646178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d31ad7a1-1c64-4fe1-8d06-809734461dbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:41.646609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d31ad7a1-1c64-4fe1-8d06-809734461dbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:41.774441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d31ad7a1-1c64-4fe1-8d06-809734461dbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:41.782530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d31ad7a1-1c64-4fe1-8d06-809734461dbb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.148910 Jun 20 06:30:41.783095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 776/1520] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:42.800572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-262349fa-4127-4cb5-84fe-c6b47b60ae5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:42.801204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-262349fa-4127-4cb5-84fe-c6b47b60ae5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:42.807705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-262349fa-4127-4cb5-84fe-c6b47b60ae5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:42.808155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-262349fa-4127-4cb5-84fe-c6b47b60ae5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:42.808907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-262349fa-4127-4cb5-84fe-c6b47b60ae5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:42.809335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-262349fa-4127-4cb5-84fe-c6b47b60ae5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:42.946254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-262349fa-4127-4cb5-84fe-c6b47b60ae5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:42.954372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-262349fa-4127-4cb5-84fe-c6b47b60ae5d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157461 Jun 20 06:30:42.955061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 777/1521] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:42 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:43.971411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6f18b54d-5b41-402b-b607-6276ad126605 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:43.972099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6f18b54d-5b41-402b-b607-6276ad126605 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:43.974231 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:43.979705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f18b54d-5b41-402b-b607-6276ad126605 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:43.980148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f18b54d-5b41-402b-b607-6276ad126605 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:43.980894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f18b54d-5b41-402b-b607-6276ad126605 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:43.981329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f18b54d-5b41-402b-b607-6276ad126605 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:44.111584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6f18b54d-5b41-402b-b607-6276ad126605 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:44.118915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6f18b54d-5b41-402b-b607-6276ad126605 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151963 Jun 20 06:30:44.119479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 778/1522] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:45.136188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-47117298-c476-42dd-ab4c-cc8805f3ae20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:45.136863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-47117298-c476-42dd-ab4c-cc8805f3ae20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:45.143772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47117298-c476-42dd-ab4c-cc8805f3ae20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:45.144215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47117298-c476-42dd-ab4c-cc8805f3ae20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:45.144975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47117298-c476-42dd-ab4c-cc8805f3ae20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:45.145426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47117298-c476-42dd-ab4c-cc8805f3ae20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:45.282366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-47117298-c476-42dd-ab4c-cc8805f3ae20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:45.289771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-47117298-c476-42dd-ab4c-cc8805f3ae20 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157386 Jun 20 06:30:45.290335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 779/1523] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:46.306854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a15b4610-42cd-43c5-85d8-d91208acc559 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:46.307524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a15b4610-42cd-43c5-85d8-d91208acc559 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:46.314738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a15b4610-42cd-43c5-85d8-d91208acc559 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:46.315188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a15b4610-42cd-43c5-85d8-d91208acc559 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:46.315952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a15b4610-42cd-43c5-85d8-d91208acc559 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:46.316386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a15b4610-42cd-43c5-85d8-d91208acc559 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:46.597303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a15b4610-42cd-43c5-85d8-d91208acc559 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:46.604772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a15b4610-42cd-43c5-85d8-d91208acc559 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.301756 Jun 20 06:30:46.605329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 780/1524] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:47.622778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cfb32d86-9eac-46b6-8702-587c430729d3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:47.623391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cfb32d86-9eac-46b6-8702-587c430729d3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:47.630261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfb32d86-9eac-46b6-8702-587c430729d3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:47.630698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfb32d86-9eac-46b6-8702-587c430729d3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:47.631444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfb32d86-9eac-46b6-8702-587c430729d3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:47.631873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfb32d86-9eac-46b6-8702-587c430729d3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:47.763871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cfb32d86-9eac-46b6-8702-587c430729d3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:47.772093 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cfb32d86-9eac-46b6-8702-587c430729d3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.153105 Jun 20 06:30:47.772634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 781/1525] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:48.789082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0d93983c-4c3b-4cf7-9b87-15a35778cc0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:48.789815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0d93983c-4c3b-4cf7-9b87-15a35778cc0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:48.796146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d93983c-4c3b-4cf7-9b87-15a35778cc0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:48.796584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d93983c-4c3b-4cf7-9b87-15a35778cc0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:48.797362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d93983c-4c3b-4cf7-9b87-15a35778cc0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:48.797904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d93983c-4c3b-4cf7-9b87-15a35778cc0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:48.928794 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d93983c-4c3b-4cf7-9b87-15a35778cc0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:48.936748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0d93983c-4c3b-4cf7-9b87-15a35778cc0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151652 Jun 20 06:30:48.937405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 782/1526] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:49.954588 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e99f7fd9-74c9-432c-844d-3ad7cb12ffc4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:49.955288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e99f7fd9-74c9-432c-844d-3ad7cb12ffc4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:49.961551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e99f7fd9-74c9-432c-844d-3ad7cb12ffc4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:49.961993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e99f7fd9-74c9-432c-844d-3ad7cb12ffc4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:49.962739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e99f7fd9-74c9-432c-844d-3ad7cb12ffc4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:49.963170 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e99f7fd9-74c9-432c-844d-3ad7cb12ffc4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:50.089964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e99f7fd9-74c9-432c-844d-3ad7cb12ffc4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:50.098250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e99f7fd9-74c9-432c-844d-3ad7cb12ffc4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.147811 Jun 20 06:30:50.098802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 783/1527] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:51.115723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3a690965-45cd-4dda-944c-584778d7bb6c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:51.116497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3a690965-45cd-4dda-944c-584778d7bb6c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:51.122783 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a690965-45cd-4dda-944c-584778d7bb6c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:51.123226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a690965-45cd-4dda-944c-584778d7bb6c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:51.123985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a690965-45cd-4dda-944c-584778d7bb6c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:51.124422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a690965-45cd-4dda-944c-584778d7bb6c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:51.255480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3a690965-45cd-4dda-944c-584778d7bb6c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:51.263015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3a690965-45cd-4dda-944c-584778d7bb6c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.151150 Jun 20 06:30:51.263578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 784/1528] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:52.280384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b7caaa22-f67b-451c-86f9-9cfb9fd6961e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:52.281039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b7caaa22-f67b-451c-86f9-9cfb9fd6961e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:52.287431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b7caaa22-f67b-451c-86f9-9cfb9fd6961e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:52.287871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b7caaa22-f67b-451c-86f9-9cfb9fd6961e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:52.288623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b7caaa22-f67b-451c-86f9-9cfb9fd6961e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:52.289055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b7caaa22-f67b-451c-86f9-9cfb9fd6961e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:52.418300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b7caaa22-f67b-451c-86f9-9cfb9fd6961e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:52.425798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b7caaa22-f67b-451c-86f9-9cfb9fd6961e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.149278 Jun 20 06:30:52.426361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 785/1529] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:53.443369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d30fdf8c-7224-4d12-9d61-0c4648499890 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:53.444014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d30fdf8c-7224-4d12-9d61-0c4648499890 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:53.450386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d30fdf8c-7224-4d12-9d61-0c4648499890 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:53.450826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d30fdf8c-7224-4d12-9d61-0c4648499890 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:53.451582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d30fdf8c-7224-4d12-9d61-0c4648499890 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:53.452009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d30fdf8c-7224-4d12-9d61-0c4648499890 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:53.586716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d30fdf8c-7224-4d12-9d61-0c4648499890 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:53.594777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d30fdf8c-7224-4d12-9d61-0c4648499890 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154648 Jun 20 06:30:53.595343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 786/1530] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:53 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:54.612325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-155f8394-fe32-4e53-8cbd-63ad0f60bdca tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:54.612881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-155f8394-fe32-4e53-8cbd-63ad0f60bdca tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:54.619396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-155f8394-fe32-4e53-8cbd-63ad0f60bdca tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:54.619835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-155f8394-fe32-4e53-8cbd-63ad0f60bdca tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:54.620586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-155f8394-fe32-4e53-8cbd-63ad0f60bdca tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:54.621011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-155f8394-fe32-4e53-8cbd-63ad0f60bdca tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:54.751420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-155f8394-fe32-4e53-8cbd-63ad0f60bdca tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:54.753620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:54.760450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-155f8394-fe32-4e53-8cbd-63ad0f60bdca tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152508 Jun 20 06:30:54.761011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 787/1531] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:55.778379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f896292c-63ef-4322-9db9-0dbf6867a93d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:55.779034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f896292c-63ef-4322-9db9-0dbf6867a93d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:55.786213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f896292c-63ef-4322-9db9-0dbf6867a93d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:55.786660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f896292c-63ef-4322-9db9-0dbf6867a93d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:55.787428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f896292c-63ef-4322-9db9-0dbf6867a93d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:55.787866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f896292c-63ef-4322-9db9-0dbf6867a93d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:55.919060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f896292c-63ef-4322-9db9-0dbf6867a93d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:55.926648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f896292c-63ef-4322-9db9-0dbf6867a93d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152176 Jun 20 06:30:55.927207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 788/1532] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:30:56.678929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-f0a25848-36e9-4e23-bfd6-fd6c1348b26b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lazy-loading 'services' on Instance uuid 4cb55995-a9da-4681-b95f-11657fea5562 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:30:56.733175 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c95874b9-274c-49a9-a261-0c58bb5d74d3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:56.734033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c95874b9-274c-49a9-a261-0c58bb5d74d3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:56.740370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c95874b9-274c-49a9-a261-0c58bb5d74d3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:56.740870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c95874b9-274c-49a9-a261-0c58bb5d74d3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:56.741742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c95874b9-274c-49a9-a261-0c58bb5d74d3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:56.742250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c95874b9-274c-49a9-a261-0c58bb5d74d3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:56.768548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c95874b9-274c-49a9-a261-0c58bb5d74d3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:30:56.843750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c95874b9-274c-49a9-a261-0c58bb5d74d3 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 204 len: 0 microversion: 2.20 time: 0.114296 Jun 20 06:30:56.844473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 789/1533] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Jun 20 06:30:56 2022] DELETE /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 06:30:56.853450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:56.854181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:56.860035 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:56.860474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:56.861227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:56.861683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:56.994886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:57.003361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:57.004857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:57.006016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-304c03d9-d3ff-4f1a-9ede-a8283299e065 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1723 microversion: 2.20 time: 0.156876 Jun 20 06:30:57.006561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 790/1534] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:30:56 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:30:57.010945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-95c3d7e4-ff86-4234-8394-ab94e1e55130 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:57.011535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-95c3d7e4-ff86-4234-8394-ab94e1e55130 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:57.017436 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95c3d7e4-ff86-4234-8394-ab94e1e55130 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:57.017883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95c3d7e4-ff86-4234-8394-ab94e1e55130 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:57.018631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95c3d7e4-ff86-4234-8394-ab94e1e55130 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:57.019056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95c3d7e4-ff86-4234-8394-ab94e1e55130 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:57.146351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-95c3d7e4-ff86-4234-8394-ab94e1e55130 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:57.153729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-95c3d7e4-ff86-4234-8394-ab94e1e55130 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.146214 Jun 20 06:30:57.154276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 791/1535] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:58.024173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:58.024813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:58.031133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:58.031756 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:58.032633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:58.033080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:58.263518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:58.271690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:58.273186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:58.274419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e12735a6-780e-41be-9e51-757524b73f4d tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1723 microversion: 2.20 time: 0.254242 Jun 20 06:30:58.274930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 792/1536] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:30:58 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:30:58.279298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4bec1079-8715-49d5-a280-5c8a729ac079 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:58.279905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4bec1079-8715-49d5-a280-5c8a729ac079 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:58.286895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4bec1079-8715-49d5-a280-5c8a729ac079 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:58.287404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4bec1079-8715-49d5-a280-5c8a729ac079 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:58.288217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4bec1079-8715-49d5-a280-5c8a729ac079 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:58.288690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4bec1079-8715-49d5-a280-5c8a729ac079 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:58.521798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4bec1079-8715-49d5-a280-5c8a729ac079 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:58.530051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4bec1079-8715-49d5-a280-5c8a729ac079 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.254117 Jun 20 06:30:58.530559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 793/1537] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:30:59.053954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-e65ea4e4-85b4-43b3-8745-babe6ab4c934 req-092aa939-ec2b-4b43-89ed-0b7addc0bd82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdad6d85-f1f9-48e6-91e0-88fca110dcb7", "name": "network-vif-deleted", "tag": "bb2ca418-d499-4457-99b9-89b22062527b"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:30:59.064029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e65ea4e4-85b4-43b3-8745-babe6ab4c934 req-092aa939-ec2b-4b43-89ed-0b7addc0bd82 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:59.064680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e65ea4e4-85b4-43b3-8745-babe6ab4c934 req-092aa939-ec2b-4b43-89ed-0b7addc0bd82 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:59.081501 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-e65ea4e4-85b4-43b3-8745-babe6ab4c934 req-092aa939-ec2b-4b43-89ed-0b7addc0bd82 service nova] Creating event network-vif-deleted:bb2ca418-d499-4457-99b9-89b22062527b for instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 on hv-cinder-80473 Jun 20 06:30:59.087885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-e65ea4e4-85b4-43b3-8745-babe6ab4c934 req-092aa939-ec2b-4b43-89ed-0b7addc0bd82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098900 Jun 20 06:30:59.088478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 794/1538] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:30:59.294663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:59.295362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:59.302627 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:59.303076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:59.303847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:59.304279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:59.340556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:59.340997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:59.341461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lazy-loading 'fault' on Instance uuid cdad6d85-f1f9-48e6-91e0-88fca110dcb7 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:30:59.384703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:59.392833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:59.394352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fc0e8fe250349d699ea43aeee98170e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2203406ec34776ab1a1e663601baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:59.396251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2b18e8b3-b2b5-42bf-9047-23c1110abfe1 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 200 len: 1372 microversion: 2.20 time: 0.105800 Jun 20 06:30:59.396984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 795/1539] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:30:59 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:30:59.548405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f43a740b-4890-4916-a9a9-deef4a727044 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:30:59.549013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f43a740b-4890-4916-a9a9-deef4a727044 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:30:59.555337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f43a740b-4890-4916-a9a9-deef4a727044 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:59.555782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f43a740b-4890-4916-a9a9-deef4a727044 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:59.557005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f43a740b-4890-4916-a9a9-deef4a727044 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:30:59.557580 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f43a740b-4890-4916-a9a9-deef4a727044 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:30:59.693571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f43a740b-4890-4916-a9a9-deef4a727044 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:30:59.701114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f43a740b-4890-4916-a9a9-deef4a727044 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.157318 Jun 20 06:30:59.701737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 796/1540] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:30:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:31:00.414220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:00.414881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:00.421161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:00.421688 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:00.422543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:00.422973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:00.435988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] HTTP exception thrown: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Request method failure captured: Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 HTTP/1.1 Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBEqJDeZtlG-76F9Hi4_noX4_tneao6vpYIiYQyaYvdpuOkX8aoM1hpdwBXJme_lnOgm3F_vrfWtSCxavSew2AgbdU00NoRsq1ru6feT1r9ReY4KmDcnf7fvgIEVVBT7oFxAdaOflWS25iHWid_ZHHLne8-r_H3tLh3LxO6zrjUIz_g Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:31:00.438169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}] Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 5fc0e8fe250349d699ea43aeee98170e Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:31:00.440049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'cdad6d85-f1f9-48e6-91e0-88fca110dcb7'} Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:31:00.441017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:31:00.442494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:31:00.443780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Returning 404 to user: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:31:00.443780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2a666532-b263-4e31-9060-98f5172a7532 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 404 len: 111 microversion: 2.20 time: 0.029134 Jun 20 06:31:00.443780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 797/1541] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:31:00 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:31:00.447869 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8b9c69c6-3c78-4d0b-926d-67832d4ca183 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '.version_select at 0x7f7a7a4b0040>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:00.450957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8b9c69c6-3c78-4d0b-926d-67832d4ca183 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [b7b80f14-9873-4de7-9fce-aaf8299f6970] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 06:31:01.458566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [None req-8b9c69c6-3c78-4d0b-926d-67832d4ca183 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [b7b80f14-9873-4de7-9fce-aaf8299f6970] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43252. Jun 20 06:31:01.477618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8b9c69c6-3c78-4d0b-926d-67832d4ca183 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596981346" status: 204 len: 0 microversion: 2.20 time: 1.033170 Jun 20 06:31:01.478189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 798/1542] 10.222.0.16 () {60 vars in 1261 bytes} [Mon Jun 20 06:31:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596981346 => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 06:31:01.482963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-95988632-3c02-4044-8380-bb5a709ea112 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:01.483682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-95988632-3c02-4044-8380-bb5a709ea112 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:01.490584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95988632-3c02-4044-8380-bb5a709ea112 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:01.491029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95988632-3c02-4044-8380-bb5a709ea112 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:01.491811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95988632-3c02-4044-8380-bb5a709ea112 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:01.492236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95988632-3c02-4044-8380-bb5a709ea112 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:01.672161 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-95988632-3c02-4044-8380-bb5a709ea112 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:31:01.681689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-95988632-3c02-4044-8380-bb5a709ea112 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.202317 Jun 20 06:31:01.682347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 799/1543] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:31:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:31:02.698981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a12964e9-9bfb-4f49-a19e-c66bd69e7c66 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:02.699617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a12964e9-9bfb-4f49-a19e-c66bd69e7c66 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:02.706359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a12964e9-9bfb-4f49-a19e-c66bd69e7c66 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:02.706809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a12964e9-9bfb-4f49-a19e-c66bd69e7c66 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:02.707576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a12964e9-9bfb-4f49-a19e-c66bd69e7c66 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:02.708013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a12964e9-9bfb-4f49-a19e-c66bd69e7c66 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:02.839939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a12964e9-9bfb-4f49-a19e-c66bd69e7c66 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:31:02.847810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a12964e9-9bfb-4f49-a19e-c66bd69e7c66 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152704 Jun 20 06:31:02.848363 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 800/1544] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:31:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:31:03.865615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0d75f9fc-94da-4e6f-a84c-a98340abb664 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:03.866290 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0d75f9fc-94da-4e6f-a84c-a98340abb664 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:03.872633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d75f9fc-94da-4e6f-a84c-a98340abb664 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:03.873076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d75f9fc-94da-4e6f-a84c-a98340abb664 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:03.873857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d75f9fc-94da-4e6f-a84c-a98340abb664 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:03.874287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d75f9fc-94da-4e6f-a84c-a98340abb664 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:04.004569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d75f9fc-94da-4e6f-a84c-a98340abb664 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:31:04.011983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0d75f9fc-94da-4e6f-a84c-a98340abb664 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150292 Jun 20 06:31:04.012537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 801/1545] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:31:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:31:05.029692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d239da34-4a22-4701-bcd0-51fcc2cfe8ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:05.030381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d239da34-4a22-4701-bcd0-51fcc2cfe8ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:05.036664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d239da34-4a22-4701-bcd0-51fcc2cfe8ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:05.037108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d239da34-4a22-4701-bcd0-51fcc2cfe8ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:05.037899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d239da34-4a22-4701-bcd0-51fcc2cfe8ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:05.038330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d239da34-4a22-4701-bcd0-51fcc2cfe8ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:05.169163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d239da34-4a22-4701-bcd0-51fcc2cfe8ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:31:05.176779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d239da34-4a22-4701-bcd0-51fcc2cfe8ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.150986 Jun 20 06:31:05.177340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 802/1546] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:31:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:31:06.194180 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-723c92e9-72c7-4307-8a23-af1d3f8e831d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:06.194903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-723c92e9-72c7-4307-8a23-af1d3f8e831d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:06.201520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-723c92e9-72c7-4307-8a23-af1d3f8e831d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:06.201979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-723c92e9-72c7-4307-8a23-af1d3f8e831d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:06.202825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-723c92e9-72c7-4307-8a23-af1d3f8e831d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:06.203422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-723c92e9-72c7-4307-8a23-af1d3f8e831d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:06.336767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-723c92e9-72c7-4307-8a23-af1d3f8e831d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:31:06.344787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-723c92e9-72c7-4307-8a23-af1d3f8e831d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.154454 Jun 20 06:31:06.345346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 803/1547] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:31:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:31:06.682746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:31:07.362213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-66c45e23-ec6f-4734-b3a3-b152d60a8700 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:07.362816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-66c45e23-ec6f-4734-b3a3-b152d60a8700 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:07.369208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66c45e23-ec6f-4734-b3a3-b152d60a8700 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:07.369677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66c45e23-ec6f-4734-b3a3-b152d60a8700 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:07.370431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66c45e23-ec6f-4734-b3a3-b152d60a8700 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:07.370862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66c45e23-ec6f-4734-b3a3-b152d60a8700 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:07.504477 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-66c45e23-ec6f-4734-b3a3-b152d60a8700 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:31:07.506776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:31:07.514138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-66c45e23-ec6f-4734-b3a3-b152d60a8700 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.156012 Jun 20 06:31:07.514694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 804/1548] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:31:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:31:08.531846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-22ce3057-9a37-4e27-addb-756965dce912 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:08.532479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-22ce3057-9a37-4e27-addb-756965dce912 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:08.539985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22ce3057-9a37-4e27-addb-756965dce912 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:08.540426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22ce3057-9a37-4e27-addb-756965dce912 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:08.541183 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22ce3057-9a37-4e27-addb-756965dce912 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:08.541663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22ce3057-9a37-4e27-addb-756965dce912 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:08.672237 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-22ce3057-9a37-4e27-addb-756965dce912 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:31:08.679807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-22ce3057-9a37-4e27-addb-756965dce912 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.152157 Jun 20 06:31:08.680368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 805/1549] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:31:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:31:08.806717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:31:08.807210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:31:08.813798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:08.814243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:08.814997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:31:08.815428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:31:10.068643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:31:10.069236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:31:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c (ip 10.222.0.16) !!! Jun 20 06:31:17.523679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:31:17.524226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:31:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c (ip 10.222.0.16) !!! Jun 20 06:31:18.810317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:31:18.834716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=11 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:31:19.762793 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:31:19.763406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:31:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c (ip 10.222.0.16) !!! Jun 20 06:32:08.903137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f0a25848-36e9-4e23-bfd6-fd6c1348b26b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c" status: 202 len: 0 microversion: 2.1 time: 120.161638 Jun 20 06:32:08.903991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 745/1550] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:30:08 2022] DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c => generated 0 bytes in 120163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:32:08.909771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e23fdcca-e71c-4036-bfee-452aca1ebd4f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:32:08.910475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e23fdcca-e71c-4036-bfee-452aca1ebd4f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:32:08.917158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e23fdcca-e71c-4036-bfee-452aca1ebd4f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:08.917880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e23fdcca-e71c-4036-bfee-452aca1ebd4f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:08.918640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e23fdcca-e71c-4036-bfee-452aca1ebd4f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:08.919077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e23fdcca-e71c-4036-bfee-452aca1ebd4f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:09.059584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e23fdcca-e71c-4036-bfee-452aca1ebd4f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:32:09.071065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lazy-loading 'services' on Instance uuid 4cb55995-a9da-4681-b95f-11657fea5562 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:32:09.071594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e23fdcca-e71c-4036-bfee-452aca1ebd4f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.165925 Jun 20 06:32:09.081546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 746/1551] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:32:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:32:09.088479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:32:09.088981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:32:09.095767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:09.096218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:09.096993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:09.097468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:19.075343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:32:19.093347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:32:19.119707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:32:56.775767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-032db4b8-6834-4e10-b7f1-f381a11acc64) Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Request method failure captured: Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c HTTP/1.1 Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBIDD20nzfr83Fhd2pEJY55NslqymEvc39YW0Kr4x0EA2Cz6oFmHb7GSlgL6v5lumsIsygAQ_fOJqS1coIYVq72s8FgvM3EVO3JXP-H2b3G5MHH4_O6SUiQ99XtMkorz1RTBXeb940rRDrTQu9hjTcaodxH5fJkepnaFdcDjjFp9dRA Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:32:56.778077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}] Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 0a38dccab9404882be501aeb64a228f6 Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:32:56.780685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-032db4b8-6834-4e10-b7f1-f381a11acc64) Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'server_id': '4cb55995-a9da-4681-b95f-11657fea5562', 'id': '5c6a62a8-0adf-4bfe-ad43-b31bc0da460c'} Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 06:32:56.781985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-032db4b8-6834-4e10-b7f1-f381a11acc64) Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:32:56.783512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-032db4b8-6834-4e10-b7f1-f381a11acc64) Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:32:56.785313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-032db4b8-6834-4e10-b7f1-f381a11acc64) Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:32:56.786964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-032db4b8-6834-4e10-b7f1-f381a11acc64) Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-032db4b8-6834-4e10-b7f1-f381a11acc64) Jun 20 06:32:56.788880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:32:56.791117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-032db4b8-6834-4e10-b7f1-f381a11acc64) {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:32:56.791117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-39eb1264-4640-4625-890c-07d8af8c2524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c" status: 400 len: 269 microversion: 2.1 time: 107.977378 Jun 20 06:32:56.791117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 806/1552] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:31:08 2022] DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c => generated 269 bytes in 107979 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:32:56.830063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lazy-loading 'services' on Instance uuid 4cb55995-a9da-4681-b95f-11657fea5562 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:32:56.983601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9368e48b-add8-4011-89f2-e74703e546d5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:32:56.984219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9368e48b-add8-4011-89f2-e74703e546d5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:32:56.990888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9368e48b-add8-4011-89f2-e74703e546d5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:56.991435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9368e48b-add8-4011-89f2-e74703e546d5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:56.992090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9368e48b-add8-4011-89f2-e74703e546d5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:56.992530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9368e48b-add8-4011-89f2-e74703e546d5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:57.126848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9368e48b-add8-4011-89f2-e74703e546d5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:32:57.134323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9368e48b-add8-4011-89f2-e74703e546d5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.352407 Jun 20 06:32:57.134883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 807/1553] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:32:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:32:57.971658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5264c89a-c7b2-46c8-a5f5-f00478005e0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:32:57.972255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5264c89a-c7b2-46c8-a5f5-f00478005e0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:32:57.978357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5264c89a-c7b2-46c8-a5f5-f00478005e0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:57.978802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5264c89a-c7b2-46c8-a5f5-f00478005e0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:57.979563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5264c89a-c7b2-46c8-a5f5-f00478005e0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:57.979996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5264c89a-c7b2-46c8-a5f5-f00478005e0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:58.006353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5264c89a-c7b2-46c8-a5f5-f00478005e0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:32:58.083638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5264c89a-c7b2-46c8-a5f5-f00478005e0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "DELETE /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 204 len: 0 microversion: 2.1 time: 0.115922 Jun 20 06:32:58.087181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 808/1554] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:32:57 2022] DELETE /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:32:58.089606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-c68f59eb-e339-4252-9e5e-26ca9433642e req-bb872819-a562-4053-9675-722e92ddbeda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0ade09-352b-4eb4-8c02-2bc3e8ed1c19", "tag": "c0a4dc40-28c7-4749-ab81-fe55f9a8c0da"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:32:58.098669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c68f59eb-e339-4252-9e5e-26ca9433642e req-bb872819-a562-4053-9675-722e92ddbeda service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:58.099103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c68f59eb-e339-4252-9e5e-26ca9433642e req-bb872819-a562-4053-9675-722e92ddbeda service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:58.110518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-c68f59eb-e339-4252-9e5e-26ca9433642e req-bb872819-a562-4053-9675-722e92ddbeda service nova] Creating event network-changed:c0a4dc40-28c7-4749-ab81-fe55f9a8c0da for instance df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 on hv-cinder-80473 Jun 20 06:32:58.115301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-c68f59eb-e339-4252-9e5e-26ca9433642e req-bb872819-a562-4053-9675-722e92ddbeda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029692 Jun 20 06:32:58.115876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 809/1555] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:32:58.120748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cff6b7a6-bb56-4ad8-9f30-21bdbf23d679 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:32:58.121457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cff6b7a6-bb56-4ad8-9f30-21bdbf23d679 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:32:58.128201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cff6b7a6-bb56-4ad8-9f30-21bdbf23d679 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:58.128766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cff6b7a6-bb56-4ad8-9f30-21bdbf23d679 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:58.129606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cff6b7a6-bb56-4ad8-9f30-21bdbf23d679 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:58.130092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cff6b7a6-bb56-4ad8-9f30-21bdbf23d679 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:58.358292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cff6b7a6-bb56-4ad8-9f30-21bdbf23d679 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:32:58.366544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cff6b7a6-bb56-4ad8-9f30-21bdbf23d679 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1568 microversion: 2.1 time: 0.249532 Jun 20 06:32:58.367244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 810/1556] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:32:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:32:59.384544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-814770ab-f64a-40ac-91df-124f44ea68a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:32:59.385150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-814770ab-f64a-40ac-91df-124f44ea68a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:32:59.392040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-814770ab-f64a-40ac-91df-124f44ea68a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:59.392480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-814770ab-f64a-40ac-91df-124f44ea68a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:59.393225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-814770ab-f64a-40ac-91df-124f44ea68a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:32:59.393690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-814770ab-f64a-40ac-91df-124f44ea68a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:32:59.523195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-814770ab-f64a-40ac-91df-124f44ea68a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:32:59.531683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-814770ab-f64a-40ac-91df-124f44ea68a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150994 Jun 20 06:32:59.532242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 811/1557] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:32:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:00.549299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1b05ff09-bd5c-4c4e-8491-34e4aaded1ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:00.550002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1b05ff09-bd5c-4c4e-8491-34e4aaded1ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:00.556197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b05ff09-bd5c-4c4e-8491-34e4aaded1ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:00.556638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b05ff09-bd5c-4c4e-8491-34e4aaded1ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:00.557407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b05ff09-bd5c-4c4e-8491-34e4aaded1ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:00.557835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b05ff09-bd5c-4c4e-8491-34e4aaded1ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:00.687546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1b05ff09-bd5c-4c4e-8491-34e4aaded1ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:33:00.694938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1b05ff09-bd5c-4c4e-8491-34e4aaded1ed tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149552 Jun 20 06:33:00.695495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 812/1558] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:33:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:01.712618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c8a982a-75d1-4c37-9e52-f1a9a124fc0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:01.713256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c8a982a-75d1-4c37-9e52-f1a9a124fc0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:01.720265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c8a982a-75d1-4c37-9e52-f1a9a124fc0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:01.720704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c8a982a-75d1-4c37-9e52-f1a9a124fc0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:01.721482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c8a982a-75d1-4c37-9e52-f1a9a124fc0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:01.721913 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c8a982a-75d1-4c37-9e52-f1a9a124fc0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:01.854050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c8a982a-75d1-4c37-9e52-f1a9a124fc0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:33:01.861356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c8a982a-75d1-4c37-9e52-f1a9a124fc0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152596 Jun 20 06:33:01.861930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 813/1559] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:33:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:02.878695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ede330ca-fceb-4d8c-82cc-756dafb29b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:02.879342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ede330ca-fceb-4d8c-82cc-756dafb29b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:02.886081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ede330ca-fceb-4d8c-82cc-756dafb29b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:02.886527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ede330ca-fceb-4d8c-82cc-756dafb29b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:02.887359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ede330ca-fceb-4d8c-82cc-756dafb29b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:02.887792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ede330ca-fceb-4d8c-82cc-756dafb29b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:03.020261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ede330ca-fceb-4d8c-82cc-756dafb29b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:33:03.027626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ede330ca-fceb-4d8c-82cc-756dafb29b73 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153052 Jun 20 06:33:03.028180 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 814/1560] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:33:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:04.046154 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-310652ad-55f0-49e9-be45-636e36827e4c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:04.046822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-310652ad-55f0-49e9-be45-636e36827e4c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:04.053203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-310652ad-55f0-49e9-be45-636e36827e4c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:04.053679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-310652ad-55f0-49e9-be45-636e36827e4c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:04.054442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-310652ad-55f0-49e9-be45-636e36827e4c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:04.054880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-310652ad-55f0-49e9-be45-636e36827e4c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:04.190534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-310652ad-55f0-49e9-be45-636e36827e4c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:33:04.197966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-310652ad-55f0-49e9-be45-636e36827e4c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.156415 Jun 20 06:33:04.198522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 815/1561] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:33:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:05.214327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ac5931b0-c355-43f1-a0df-79d8606b9abf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:05.215029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ac5931b0-c355-43f1-a0df-79d8606b9abf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:05.221396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac5931b0-c355-43f1-a0df-79d8606b9abf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:05.221877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac5931b0-c355-43f1-a0df-79d8606b9abf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:05.222624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac5931b0-c355-43f1-a0df-79d8606b9abf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:05.223078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac5931b0-c355-43f1-a0df-79d8606b9abf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:05.356852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ac5931b0-c355-43f1-a0df-79d8606b9abf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:33:05.365185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ac5931b0-c355-43f1-a0df-79d8606b9abf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154667 Jun 20 06:33:05.365776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 816/1562] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:33:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:06.383701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4f3ce5ee-1f06-4ee9-b8a3-b054487a2222 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:06.384389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4f3ce5ee-1f06-4ee9-b8a3-b054487a2222 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:06.391764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f3ce5ee-1f06-4ee9-b8a3-b054487a2222 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:06.392210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f3ce5ee-1f06-4ee9-b8a3-b054487a2222 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:06.392969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f3ce5ee-1f06-4ee9-b8a3-b054487a2222 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:06.393425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f3ce5ee-1f06-4ee9-b8a3-b054487a2222 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:06.523833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4f3ce5ee-1f06-4ee9-b8a3-b054487a2222 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:33:06.532115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4f3ce5ee-1f06-4ee9-b8a3-b054487a2222 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152267 Jun 20 06:33:06.532679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 817/1563] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:33:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:06.833914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:33:07.548646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1a48bdff-2139-438f-b215-ffd2fb5240e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:07.549305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1a48bdff-2139-438f-b215-ffd2fb5240e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:07.556780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a48bdff-2139-438f-b215-ffd2fb5240e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:07.557224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a48bdff-2139-438f-b215-ffd2fb5240e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:07.558020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a48bdff-2139-438f-b215-ffd2fb5240e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:07.558455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a48bdff-2139-438f-b215-ffd2fb5240e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:07.687831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1a48bdff-2139-438f-b215-ffd2fb5240e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:33:07.695184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1a48bdff-2139-438f-b215-ffd2fb5240e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150886 Jun 20 06:33:07.695740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 818/1564] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:33:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:08.712591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2ea26d20-b380-4780-9e29-053a1c495f9a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:08.713207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2ea26d20-b380-4780-9e29-053a1c495f9a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:08.720573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ea26d20-b380-4780-9e29-053a1c495f9a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:08.721027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ea26d20-b380-4780-9e29-053a1c495f9a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:08.721815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ea26d20-b380-4780-9e29-053a1c495f9a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:08.722248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ea26d20-b380-4780-9e29-053a1c495f9a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:08.855341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2ea26d20-b380-4780-9e29-053a1c495f9a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:33:08.863704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2ea26d20-b380-4780-9e29-053a1c495f9a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154977 Jun 20 06:33:08.864278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 819/1565] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:33:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:33:08.928999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:33:08.929543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:33:08.935293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:08.935731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:08.936476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:33:08.936902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:33:18.932926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:33:18.956383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:34:09.264099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee1dae0c-58b1-4b50-87ed-04fddf353b82) Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Request method failure captured: Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c HTTP/1.1 Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBIDD20nzfr83Fhd2pEJY55NslqymEvc39YW0Kr4x0EA2Cz6oFmHb7GSlgL6v5lumsIsygAQ_fOJqS1coIYVq72s8FgvM3EVO3JXP-H2b3G5MHH4_O6SUiQ99XtMkorz1RTBXeb940rRDrTQu9hjTcaodxH5fJkepnaFdcDjjFp9dRA Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:34:09.266827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}] Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 0a38dccab9404882be501aeb64a228f6 Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:34:09.268383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee1dae0c-58b1-4b50-87ed-04fddf353b82) Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '4cb55995-a9da-4681-b95f-11657fea5562', 'id': '5c6a62a8-0adf-4bfe-ad43-b31bc0da460c'} Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 06:34:09.269422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee1dae0c-58b1-4b50-87ed-04fddf353b82) Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:34:09.270644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee1dae0c-58b1-4b50-87ed-04fddf353b82) Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.271924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee1dae0c-58b1-4b50-87ed-04fddf353b82) Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:34:09.273032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee1dae0c-58b1-4b50-87ed-04fddf353b82) Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee1dae0c-58b1-4b50-87ed-04fddf353b82) Jun 20 06:34:09.274586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.277901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee1dae0c-58b1-4b50-87ed-04fddf353b82) {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:34:09.277901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c8263bed-2377-4645-9392-5e1db127f8d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c" status: 400 len: 269 microversion: 2.1 time: 120.185459 Jun 20 06:34:09.277901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 747/1566] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:32:09 2022] DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c => generated 269 bytes in 120186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:34:09.277901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-046b4e04-929d-414d-a007-834cde8fa3ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:09.278305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-046b4e04-929d-414d-a007-834cde8fa3ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:09.282408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-046b4e04-929d-414d-a007-834cde8fa3ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:09.282861 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-046b4e04-929d-414d-a007-834cde8fa3ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:09.283646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-046b4e04-929d-414d-a007-834cde8fa3ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:09.284087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-046b4e04-929d-414d-a007-834cde8fa3ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:09.398705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lazy-loading 'services' on Instance uuid 4cb55995-a9da-4681-b95f-11657fea5562 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:34:09.425210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-046b4e04-929d-414d-a007-834cde8fa3ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:09.432782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-046b4e04-929d-414d-a007-834cde8fa3ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.162737 Jun 20 06:34:09.440010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 748/1567] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:09.440010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:09.440010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:09.444537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:09.444982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:09.445780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:09.446198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:09.509939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17a364cc-4ef6-4602-ab22-1797a2638d53) Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Request method failure captured: Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c HTTP/1.1 Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBIDD20nzfr83Fhd2pEJY55NslqymEvc39YW0Kr4x0EA2Cz6oFmHb7GSlgL6v5lumsIsygAQ_fOJqS1coIYVq72s8FgvM3EVO3JXP-H2b3G5MHH4_O6SUiQ99XtMkorz1RTBXeb940rRDrTQu9hjTcaodxH5fJkepnaFdcDjjFp9dRA Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:34:09.512234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}] Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 0a38dccab9404882be501aeb64a228f6 Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:34:09.513996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17a364cc-4ef6-4602-ab22-1797a2638d53) Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'server_id': '4cb55995-a9da-4681-b95f-11657fea5562', 'id': '5c6a62a8-0adf-4bfe-ad43-b31bc0da460c'} Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 06:34:09.515452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17a364cc-4ef6-4602-ab22-1797a2638d53) Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:34:09.516975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17a364cc-4ef6-4602-ab22-1797a2638d53) Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17a364cc-4ef6-4602-ab22-1797a2638d53) Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:34:09.519839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17a364cc-4ef6-4602-ab22-1797a2638d53) Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17a364cc-4ef6-4602-ab22-1797a2638d53) Jun 20 06:34:09.521233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.522633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17a364cc-4ef6-4602-ab22-1797a2638d53) {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:34:09.522633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6d269ad3-4990-4ae0-b9f5-3646663bd1b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c" status: 400 len: 269 microversion: 2.1 time: 60.588527 Jun 20 06:34:09.522633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 820/1568] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:33:08 2022] DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c => generated 269 bytes in 60590 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:34:09.558097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lazy-loading 'services' on Instance uuid 4cb55995-a9da-4681-b95f-11657fea5562 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:34:09.615826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38199c35-efed-4f84-910b-80d791803fa7) Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Request method failure captured: Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c HTTP/1.1 Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBIDD20nzfr83Fhd2pEJY55NslqymEvc39YW0Kr4x0EA2Cz6oFmHb7GSlgL6v5lumsIsygAQ_fOJqS1coIYVq72s8FgvM3EVO3JXP-H2b3G5MHH4_O6SUiQ99XtMkorz1RTBXeb940rRDrTQu9hjTcaodxH5fJkepnaFdcDjjFp9dRA Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:34:09.618037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}] Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 0a38dccab9404882be501aeb64a228f6 Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:34:09.619746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38199c35-efed-4f84-910b-80d791803fa7) Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '4cb55995-a9da-4681-b95f-11657fea5562', 'id': '5c6a62a8-0adf-4bfe-ad43-b31bc0da460c'} Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 06:34:09.620495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38199c35-efed-4f84-910b-80d791803fa7) Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:34:09.621975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38199c35-efed-4f84-910b-80d791803fa7) Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.623526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38199c35-efed-4f84-910b-80d791803fa7) Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:34:09.624905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38199c35-efed-4f84-910b-80d791803fa7) Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38199c35-efed-4f84-910b-80d791803fa7) Jun 20 06:34:09.626353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:34:09.627735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38199c35-efed-4f84-910b-80d791803fa7) {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:34:09.627735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3affa1dc-4d2d-437c-a2d7-cbbd67fb88d9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c" status: 400 len: 269 microversion: 2.1 time: 0.184895 Jun 20 06:34:09.627735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 749/1569] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:34:09 2022] DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562/os-volume_attachments/5c6a62a8-0adf-4bfe-ad43-b31bc0da460c => generated 269 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:34:10.451119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d32e5137-ada8-48b9-868f-a6a985979e0e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:10.451723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d32e5137-ada8-48b9-868f-a6a985979e0e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:10.458755 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d32e5137-ada8-48b9-868f-a6a985979e0e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:10.459198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d32e5137-ada8-48b9-868f-a6a985979e0e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:10.459948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d32e5137-ada8-48b9-868f-a6a985979e0e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:10.460377 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d32e5137-ada8-48b9-868f-a6a985979e0e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:10.588248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d32e5137-ada8-48b9-868f-a6a985979e0e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:10.595907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d32e5137-ada8-48b9-868f-a6a985979e0e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149698 Jun 20 06:34:10.596458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 821/1570] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:10 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:11.612797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c6d3d3e5-beac-4fb6-8764-2546db5ee69e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:11.613345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c6d3d3e5-beac-4fb6-8764-2546db5ee69e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:11.619894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3e5-beac-4fb6-8764-2546db5ee69e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:11.620337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3e5-beac-4fb6-8764-2546db5ee69e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:11.621084 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3e5-beac-4fb6-8764-2546db5ee69e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:11.621546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3e5-beac-4fb6-8764-2546db5ee69e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:11.751995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c6d3d3e5-beac-4fb6-8764-2546db5ee69e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:11.759390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c6d3d3e5-beac-4fb6-8764-2546db5ee69e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151114 Jun 20 06:34:11.759945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 750/1571] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:12.777188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b967da9a-3210-41c1-bdb5-a1a5838e4378 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:12.777821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b967da9a-3210-41c1-bdb5-a1a5838e4378 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:12.784919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b967da9a-3210-41c1-bdb5-a1a5838e4378 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:12.785362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b967da9a-3210-41c1-bdb5-a1a5838e4378 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:12.786130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b967da9a-3210-41c1-bdb5-a1a5838e4378 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:12.786558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b967da9a-3210-41c1-bdb5-a1a5838e4378 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:12.913280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b967da9a-3210-41c1-bdb5-a1a5838e4378 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:12.920819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b967da9a-3210-41c1-bdb5-a1a5838e4378 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.147456 Jun 20 06:34:12.921403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 822/1572] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:13.938685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8e6eb7dc-8eb7-4c1a-a7db-921b24fba6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:13.939308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8e6eb7dc-8eb7-4c1a-a7db-921b24fba6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:13.945753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e6eb7dc-8eb7-4c1a-a7db-921b24fba6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:13.946196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e6eb7dc-8eb7-4c1a-a7db-921b24fba6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:13.946951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e6eb7dc-8eb7-4c1a-a7db-921b24fba6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:13.947383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e6eb7dc-8eb7-4c1a-a7db-921b24fba6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:14.075378 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8e6eb7dc-8eb7-4c1a-a7db-921b24fba6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:14.083224 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8e6eb7dc-8eb7-4c1a-a7db-921b24fba6f7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149120 Jun 20 06:34:14.083775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 751/1573] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:15.100699 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7980526c-ac9f-4a0b-b0df-129847b18209 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:15.101266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7980526c-ac9f-4a0b-b0df-129847b18209 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:15.107522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7980526c-ac9f-4a0b-b0df-129847b18209 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:15.107964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7980526c-ac9f-4a0b-b0df-129847b18209 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:15.108720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7980526c-ac9f-4a0b-b0df-129847b18209 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:15.109147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7980526c-ac9f-4a0b-b0df-129847b18209 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:15.241080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7980526c-ac9f-4a0b-b0df-129847b18209 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:15.248495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7980526c-ac9f-4a0b-b0df-129847b18209 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152178 Jun 20 06:34:15.249061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 823/1574] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:15 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:16.267041 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c965b092-a253-4e52-88da-9b23d99f272c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:16.267675 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c965b092-a253-4e52-88da-9b23d99f272c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:16.273831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c965b092-a253-4e52-88da-9b23d99f272c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:16.274282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c965b092-a253-4e52-88da-9b23d99f272c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:16.275042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c965b092-a253-4e52-88da-9b23d99f272c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:16.275476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c965b092-a253-4e52-88da-9b23d99f272c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:16.406221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c965b092-a253-4e52-88da-9b23d99f272c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:16.414309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c965b092-a253-4e52-88da-9b23d99f272c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151856 Jun 20 06:34:16.414878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 752/1575] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:17.431332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-339d37eb-9a9e-4025-ac10-8e9a68146f9e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:17.431939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-339d37eb-9a9e-4025-ac10-8e9a68146f9e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:17.438505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-339d37eb-9a9e-4025-ac10-8e9a68146f9e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:17.438946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-339d37eb-9a9e-4025-ac10-8e9a68146f9e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:17.439725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-339d37eb-9a9e-4025-ac10-8e9a68146f9e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:17.440156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-339d37eb-9a9e-4025-ac10-8e9a68146f9e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:17.573370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-339d37eb-9a9e-4025-ac10-8e9a68146f9e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:17.581528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-339d37eb-9a9e-4025-ac10-8e9a68146f9e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154041 Jun 20 06:34:17.582080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 824/1576] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:17 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:18.598746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-09902194-fcc3-4509-93a5-e88fb5bb8163 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:18.599283 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-09902194-fcc3-4509-93a5-e88fb5bb8163 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:18.605907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09902194-fcc3-4509-93a5-e88fb5bb8163 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:18.606350 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09902194-fcc3-4509-93a5-e88fb5bb8163 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:18.607126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09902194-fcc3-4509-93a5-e88fb5bb8163 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:18.607559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09902194-fcc3-4509-93a5-e88fb5bb8163 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:18.737354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-09902194-fcc3-4509-93a5-e88fb5bb8163 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:18.744765 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-09902194-fcc3-4509-93a5-e88fb5bb8163 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150579 Jun 20 06:34:18.745318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 753/1577] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:19.762882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a484a75-244a-4f13-bc42-59245f2ad6a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:19.763486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8a484a75-244a-4f13-bc42-59245f2ad6a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:19.770818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a484a75-244a-4f13-bc42-59245f2ad6a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:19.771249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a484a75-244a-4f13-bc42-59245f2ad6a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:19.772066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a484a75-244a-4f13-bc42-59245f2ad6a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:19.772497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a484a75-244a-4f13-bc42-59245f2ad6a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:19.900761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a484a75-244a-4f13-bc42-59245f2ad6a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:19.908857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a484a75-244a-4f13-bc42-59245f2ad6a9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149797 Jun 20 06:34:19.909482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 825/1578] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:34:20.926741 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a2b7d6ef-82d2-44f0-ab0b-e259e16d824b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:20.927364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a2b7d6ef-82d2-44f0-ab0b-e259e16d824b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:20.933930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2b7d6ef-82d2-44f0-ab0b-e259e16d824b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:20.934387 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2b7d6ef-82d2-44f0-ab0b-e259e16d824b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:20.935153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2b7d6ef-82d2-44f0-ab0b-e259e16d824b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:20.935593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2b7d6ef-82d2-44f0-ab0b-e259e16d824b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:21.068063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a2b7d6ef-82d2-44f0-ab0b-e259e16d824b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:21.075484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a2b7d6ef-82d2-44f0-ab0b-e259e16d824b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153383 Jun 20 06:34:21.076139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 754/1579] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:22.093177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38934ab2-a03c-45a3-858c-79bc1a3e4baf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:22.093965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-38934ab2-a03c-45a3-858c-79bc1a3e4baf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:22.100956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38934ab2-a03c-45a3-858c-79bc1a3e4baf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:22.101426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38934ab2-a03c-45a3-858c-79bc1a3e4baf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:22.102185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38934ab2-a03c-45a3-858c-79bc1a3e4baf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:22.102619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38934ab2-a03c-45a3-858c-79bc1a3e4baf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:22.234203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-38934ab2-a03c-45a3-858c-79bc1a3e4baf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:22.242219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-38934ab2-a03c-45a3-858c-79bc1a3e4baf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152910 Jun 20 06:34:22.242786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 826/1580] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:22 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:23.259195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-50514c40-78d6-418f-9c45-6107b0f83a76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:23.259811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-50514c40-78d6-418f-9c45-6107b0f83a76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:23.267291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50514c40-78d6-418f-9c45-6107b0f83a76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:23.267744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50514c40-78d6-418f-9c45-6107b0f83a76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:23.268509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50514c40-78d6-418f-9c45-6107b0f83a76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:23.268947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-50514c40-78d6-418f-9c45-6107b0f83a76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:23.404117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-50514c40-78d6-418f-9c45-6107b0f83a76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:23.412046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-50514c40-78d6-418f-9c45-6107b0f83a76 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.156695 Jun 20 06:34:23.412601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 755/1581] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:34:24.429701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a08ac48e-fdf5-4254-887c-efdabd8201b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:24.430317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a08ac48e-fdf5-4254-887c-efdabd8201b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:24.436739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a08ac48e-fdf5-4254-887c-efdabd8201b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:24.437187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a08ac48e-fdf5-4254-887c-efdabd8201b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:24.438623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a08ac48e-fdf5-4254-887c-efdabd8201b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:24.439055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a08ac48e-fdf5-4254-887c-efdabd8201b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:24.572242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a08ac48e-fdf5-4254-887c-efdabd8201b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:24.582660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a08ac48e-fdf5-4254-887c-efdabd8201b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.156608 Jun 20 06:34:24.583173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 827/1582] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:24 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:25.600119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e4820ac9-4623-46d2-8e17-fa30d691778d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:25.600662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e4820ac9-4623-46d2-8e17-fa30d691778d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:25.607141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4820ac9-4623-46d2-8e17-fa30d691778d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:25.607589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4820ac9-4623-46d2-8e17-fa30d691778d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:25.608337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4820ac9-4623-46d2-8e17-fa30d691778d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:25.608767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4820ac9-4623-46d2-8e17-fa30d691778d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:25.748717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4820ac9-4623-46d2-8e17-fa30d691778d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:25.756734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e4820ac9-4623-46d2-8e17-fa30d691778d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.160558 Jun 20 06:34:25.757290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 756/1583] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:25 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:26.773973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b12acef4-4083-4cc5-aeed-92235522b38e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:26.774576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b12acef4-4083-4cc5-aeed-92235522b38e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:26.781316 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b12acef4-4083-4cc5-aeed-92235522b38e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:26.781789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b12acef4-4083-4cc5-aeed-92235522b38e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:26.782590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b12acef4-4083-4cc5-aeed-92235522b38e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:26.783023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b12acef4-4083-4cc5-aeed-92235522b38e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:26.911877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b12acef4-4083-4cc5-aeed-92235522b38e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:26.919373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b12acef4-4083-4cc5-aeed-92235522b38e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149290 Jun 20 06:34:26.919944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 828/1584] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:27.937142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f46c081-037c-4615-8972-0477eda2fe35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:27.937780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f46c081-037c-4615-8972-0477eda2fe35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:27.945277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f46c081-037c-4615-8972-0477eda2fe35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:27.945763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f46c081-037c-4615-8972-0477eda2fe35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:27.946526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f46c081-037c-4615-8972-0477eda2fe35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:27.946962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f46c081-037c-4615-8972-0477eda2fe35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:28.079819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f46c081-037c-4615-8972-0477eda2fe35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:28.087282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f46c081-037c-4615-8972-0477eda2fe35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154031 Jun 20 06:34:28.087847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 757/1585] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:27 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:29.104572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-46cdb1cf-97b4-4279-883d-f94e3d572537 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:29.105130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-46cdb1cf-97b4-4279-883d-f94e3d572537 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:29.111914 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46cdb1cf-97b4-4279-883d-f94e3d572537 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:29.112364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46cdb1cf-97b4-4279-883d-f94e3d572537 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:29.113128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46cdb1cf-97b4-4279-883d-f94e3d572537 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:29.113594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46cdb1cf-97b4-4279-883d-f94e3d572537 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:29.253600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-46cdb1cf-97b4-4279-883d-f94e3d572537 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:29.260983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-46cdb1cf-97b4-4279-883d-f94e3d572537 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.160427 Jun 20 06:34:29.261571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 829/1586] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:30.076904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:34:30.077510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:34:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:34:30.278508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-13ab5dbd-ad38-4191-a90b-d4dc6718eaa7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:30.279123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-13ab5dbd-ad38-4191-a90b-d4dc6718eaa7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:30.285781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13ab5dbd-ad38-4191-a90b-d4dc6718eaa7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:30.286225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13ab5dbd-ad38-4191-a90b-d4dc6718eaa7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:30.287015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13ab5dbd-ad38-4191-a90b-d4dc6718eaa7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:30.287448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13ab5dbd-ad38-4191-a90b-d4dc6718eaa7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:30.418333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-13ab5dbd-ad38-4191-a90b-d4dc6718eaa7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:30.426518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-13ab5dbd-ad38-4191-a90b-d4dc6718eaa7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151849 Jun 20 06:34:30.427085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 758/1587] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:31.444122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f6720a8-a486-443a-866a-41c38fa7628d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:31.444741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f6720a8-a486-443a-866a-41c38fa7628d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:31.451222 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f6720a8-a486-443a-866a-41c38fa7628d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:31.451672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f6720a8-a486-443a-866a-41c38fa7628d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:31.452431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f6720a8-a486-443a-866a-41c38fa7628d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:31.452868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f6720a8-a486-443a-866a-41c38fa7628d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:31.586224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7f6720a8-a486-443a-866a-41c38fa7628d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:31.593644 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f6720a8-a486-443a-866a-41c38fa7628d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154054 Jun 20 06:34:31.594202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 830/1588] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:31 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:32.611393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-21ba81d9-99cb-49e5-b9e7-89021269ace6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:32.612559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-21ba81d9-99cb-49e5-b9e7-89021269ace6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:32.619293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21ba81d9-99cb-49e5-b9e7-89021269ace6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:32.619833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21ba81d9-99cb-49e5-b9e7-89021269ace6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:32.620765 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21ba81d9-99cb-49e5-b9e7-89021269ace6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:32.621204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21ba81d9-99cb-49e5-b9e7-89021269ace6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:32.750705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-21ba81d9-99cb-49e5-b9e7-89021269ace6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:32.758908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-21ba81d9-99cb-49e5-b9e7-89021269ace6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151458 Jun 20 06:34:32.759575 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 759/1589] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:32 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:33.776077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dff08d1b-d4cf-451b-9f5d-693a0f0cb981 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:33.776690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dff08d1b-d4cf-451b-9f5d-693a0f0cb981 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:33.782897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dff08d1b-d4cf-451b-9f5d-693a0f0cb981 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:33.783339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dff08d1b-d4cf-451b-9f5d-693a0f0cb981 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:33.784087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dff08d1b-d4cf-451b-9f5d-693a0f0cb981 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:33.784516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dff08d1b-d4cf-451b-9f5d-693a0f0cb981 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:33.914771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dff08d1b-d4cf-451b-9f5d-693a0f0cb981 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:33.922461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dff08d1b-d4cf-451b-9f5d-693a0f0cb981 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149888 Jun 20 06:34:33.923024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 831/1590] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:33 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:34.939661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91d30579-6289-48e2-91de-4c5b623b2d9f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:34.940191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91d30579-6289-48e2-91de-4c5b623b2d9f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:34.947573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91d30579-6289-48e2-91de-4c5b623b2d9f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:34.948043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91d30579-6289-48e2-91de-4c5b623b2d9f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:34.948868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91d30579-6289-48e2-91de-4c5b623b2d9f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:34.949369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91d30579-6289-48e2-91de-4c5b623b2d9f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:35.079921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-91d30579-6289-48e2-91de-4c5b623b2d9f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:35.087611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91d30579-6289-48e2-91de-4c5b623b2d9f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152000 Jun 20 06:34:35.088173 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 760/1591] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:36.104576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8ffded43-68d8-4d6e-8289-950880933ceb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:36.105259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8ffded43-68d8-4d6e-8289-950880933ceb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:36.111690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ffded43-68d8-4d6e-8289-950880933ceb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:36.112130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ffded43-68d8-4d6e-8289-950880933ceb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:36.112874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ffded43-68d8-4d6e-8289-950880933ceb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:36.114043 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ffded43-68d8-4d6e-8289-950880933ceb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:36.249430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8ffded43-68d8-4d6e-8289-950880933ceb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:36.258663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8ffded43-68d8-4d6e-8289-950880933ceb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.158033 Jun 20 06:34:36.259222 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 832/1592] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:37.276098 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2241235c-070b-4378-8da2-b71bff22ce03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:37.276915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2241235c-070b-4378-8da2-b71bff22ce03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:37.283843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2241235c-070b-4378-8da2-b71bff22ce03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:37.284290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2241235c-070b-4378-8da2-b71bff22ce03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:37.285052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2241235c-070b-4378-8da2-b71bff22ce03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:37.285553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2241235c-070b-4378-8da2-b71bff22ce03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:37.288587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=81 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:34:37.421477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2241235c-070b-4378-8da2-b71bff22ce03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:37.428844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2241235c-070b-4378-8da2-b71bff22ce03 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.156991 Jun 20 06:34:37.429414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 761/1593] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:34:37.533692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:34:37.534189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:34:38.446055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4d19b601-9f4f-4d27-9915-33a12befc314 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:38.446702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4d19b601-9f4f-4d27-9915-33a12befc314 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:38.453401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d19b601-9f4f-4d27-9915-33a12befc314 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:38.453854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d19b601-9f4f-4d27-9915-33a12befc314 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:38.454607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d19b601-9f4f-4d27-9915-33a12befc314 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:38.455042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d19b601-9f4f-4d27-9915-33a12befc314 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:38.583725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4d19b601-9f4f-4d27-9915-33a12befc314 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:38.591117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4d19b601-9f4f-4d27-9915-33a12befc314 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149302 Jun 20 06:34:38.591676 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 833/1594] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:38 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:39.608051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-92ee0f5c-fe0f-4194-927f-2f6f012c4ab9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:39.608659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-92ee0f5c-fe0f-4194-927f-2f6f012c4ab9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:39.610986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=29 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:34:39.617578 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92ee0f5c-fe0f-4194-927f-2f6f012c4ab9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:39.618058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92ee0f5c-fe0f-4194-927f-2f6f012c4ab9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:39.618821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92ee0f5c-fe0f-4194-927f-2f6f012c4ab9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:39.619288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-92ee0f5c-fe0f-4194-927f-2f6f012c4ab9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:39.755739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-92ee0f5c-fe0f-4194-927f-2f6f012c4ab9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:39.763360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-92ee0f5c-fe0f-4194-927f-2f6f012c4ab9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.159129 Jun 20 06:34:39.763925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 762/1595] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:39 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:39.770940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:34:39.771102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:34:40.781721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0f90a229-3955-4c45-bc48-cd36a5777cd7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:40.782328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0f90a229-3955-4c45-bc48-cd36a5777cd7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:40.784715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=27 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:34:40.790781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f90a229-3955-4c45-bc48-cd36a5777cd7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:40.791219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f90a229-3955-4c45-bc48-cd36a5777cd7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:40.791979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f90a229-3955-4c45-bc48-cd36a5777cd7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:40.792407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f90a229-3955-4c45-bc48-cd36a5777cd7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:40.796373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=83 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:34:40.921055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0f90a229-3955-4c45-bc48-cd36a5777cd7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:40.928976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0f90a229-3955-4c45-bc48-cd36a5777cd7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151169 Jun 20 06:34:40.929563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 834/1596] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:41.946035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2edfa416-19f2-4578-ad90-7c87695b248c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:41.946837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2edfa416-19f2-4578-ad90-7c87695b248c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:41.953442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2edfa416-19f2-4578-ad90-7c87695b248c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:41.953891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2edfa416-19f2-4578-ad90-7c87695b248c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:41.954656 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2edfa416-19f2-4578-ad90-7c87695b248c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:41.955088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2edfa416-19f2-4578-ad90-7c87695b248c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:42.089601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2edfa416-19f2-4578-ad90-7c87695b248c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:42.097212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2edfa416-19f2-4578-ad90-7c87695b248c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155748 Jun 20 06:34:42.097795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 763/1597] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:43.116111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c825abbe-30d6-406b-893c-add98db7882b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:43.116708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c825abbe-30d6-406b-893c-add98db7882b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:43.123065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c825abbe-30d6-406b-893c-add98db7882b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:43.123513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c825abbe-30d6-406b-893c-add98db7882b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:43.124270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c825abbe-30d6-406b-893c-add98db7882b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:43.124708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c825abbe-30d6-406b-893c-add98db7882b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:43.258518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c825abbe-30d6-406b-893c-add98db7882b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:43.266177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c825abbe-30d6-406b-893c-add98db7882b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155329 Jun 20 06:34:43.266733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 835/1598] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:44.283471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8729ae5-050a-4192-a3e7-1d58f1a744d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:44.284066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8729ae5-050a-4192-a3e7-1d58f1a744d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:44.291271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8729ae5-050a-4192-a3e7-1d58f1a744d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:44.291723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8729ae5-050a-4192-a3e7-1d58f1a744d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:44.292488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8729ae5-050a-4192-a3e7-1d58f1a744d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:44.292923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8729ae5-050a-4192-a3e7-1d58f1a744d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:44.427696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8729ae5-050a-4192-a3e7-1d58f1a744d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:44.435160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8729ae5-050a-4192-a3e7-1d58f1a744d6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155584 Jun 20 06:34:44.435708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 764/1599] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:45.452776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bf04e1ba-f5d1-4d2f-a658-52bb38d5cfc0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:45.453404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bf04e1ba-f5d1-4d2f-a658-52bb38d5cfc0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:45.459959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf04e1ba-f5d1-4d2f-a658-52bb38d5cfc0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:45.460397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf04e1ba-f5d1-4d2f-a658-52bb38d5cfc0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:45.461283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf04e1ba-f5d1-4d2f-a658-52bb38d5cfc0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:45.461806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf04e1ba-f5d1-4d2f-a658-52bb38d5cfc0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:45.598621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bf04e1ba-f5d1-4d2f-a658-52bb38d5cfc0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:45.608812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bf04e1ba-f5d1-4d2f-a658-52bb38d5cfc0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.159809 Jun 20 06:34:45.609370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 836/1600] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:46.627150 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c5a54a0-53eb-4525-ba39-4739002494e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:46.627705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c5a54a0-53eb-4525-ba39-4739002494e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:46.634562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c5a54a0-53eb-4525-ba39-4739002494e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:46.635013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c5a54a0-53eb-4525-ba39-4739002494e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:46.635775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c5a54a0-53eb-4525-ba39-4739002494e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:46.636209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c5a54a0-53eb-4525-ba39-4739002494e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:46.767008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c5a54a0-53eb-4525-ba39-4739002494e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:46.775239 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c5a54a0-53eb-4525-ba39-4739002494e2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152178 Jun 20 06:34:46.775802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 765/1601] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:47.792565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f1eb18c-75bf-454d-a837-89cae29004ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:47.793173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f1eb18c-75bf-454d-a837-89cae29004ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:47.799533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f1eb18c-75bf-454d-a837-89cae29004ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:47.799969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f1eb18c-75bf-454d-a837-89cae29004ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:47.800715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f1eb18c-75bf-454d-a837-89cae29004ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:47.801142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f1eb18c-75bf-454d-a837-89cae29004ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:47.928823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7f1eb18c-75bf-454d-a837-89cae29004ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:47.936249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f1eb18c-75bf-454d-a837-89cae29004ac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.147529 Jun 20 06:34:47.936808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 837/1602] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:48.953370 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2e041a5e-1cc1-4d42-9d6c-bbe33b9f9547 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:48.953967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2e041a5e-1cc1-4d42-9d6c-bbe33b9f9547 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:48.960628 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e041a5e-1cc1-4d42-9d6c-bbe33b9f9547 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:48.961082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e041a5e-1cc1-4d42-9d6c-bbe33b9f9547 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:48.961887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e041a5e-1cc1-4d42-9d6c-bbe33b9f9547 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:48.962331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e041a5e-1cc1-4d42-9d6c-bbe33b9f9547 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:49.096362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2e041a5e-1cc1-4d42-9d6c-bbe33b9f9547 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:49.104459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2e041a5e-1cc1-4d42-9d6c-bbe33b9f9547 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155090 Jun 20 06:34:49.105023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 766/1603] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:50.121923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-28cacfb2-3a5c-46a2-b657-c2c349dd2624 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:50.122622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-28cacfb2-3a5c-46a2-b657-c2c349dd2624 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:50.128992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28cacfb2-3a5c-46a2-b657-c2c349dd2624 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:50.129467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28cacfb2-3a5c-46a2-b657-c2c349dd2624 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:50.130226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28cacfb2-3a5c-46a2-b657-c2c349dd2624 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:50.130662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-28cacfb2-3a5c-46a2-b657-c2c349dd2624 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:50.260215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-28cacfb2-3a5c-46a2-b657-c2c349dd2624 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:50.267886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-28cacfb2-3a5c-46a2-b657-c2c349dd2624 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149809 Jun 20 06:34:50.268436 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 838/1604] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:51.284833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4008860f-4903-44fb-98db-21a4fbbf9682 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:51.285467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4008860f-4903-44fb-98db-21a4fbbf9682 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:51.291964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4008860f-4903-44fb-98db-21a4fbbf9682 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:51.292411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4008860f-4903-44fb-98db-21a4fbbf9682 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:51.293159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4008860f-4903-44fb-98db-21a4fbbf9682 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:51.293619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4008860f-4903-44fb-98db-21a4fbbf9682 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:51.425557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4008860f-4903-44fb-98db-21a4fbbf9682 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:51.433634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4008860f-4903-44fb-98db-21a4fbbf9682 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152667 Jun 20 06:34:51.434181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 767/1605] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:52.450606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-88d73200-b94a-47a0-93d6-d1404510a0bb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:52.451224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-88d73200-b94a-47a0-93d6-d1404510a0bb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:52.457762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88d73200-b94a-47a0-93d6-d1404510a0bb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:52.458210 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88d73200-b94a-47a0-93d6-d1404510a0bb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:52.458967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88d73200-b94a-47a0-93d6-d1404510a0bb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:52.459892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-88d73200-b94a-47a0-93d6-d1404510a0bb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:52.589356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-88d73200-b94a-47a0-93d6-d1404510a0bb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:52.596835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-88d73200-b94a-47a0-93d6-d1404510a0bb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150068 Jun 20 06:34:52.597420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 839/1606] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:53.614176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-042bbd28-558b-4721-96e5-7245ca03f040 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:53.614730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-042bbd28-558b-4721-96e5-7245ca03f040 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:53.621854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-042bbd28-558b-4721-96e5-7245ca03f040 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:53.622311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-042bbd28-558b-4721-96e5-7245ca03f040 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:53.623081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-042bbd28-558b-4721-96e5-7245ca03f040 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:53.623527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-042bbd28-558b-4721-96e5-7245ca03f040 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:53.756390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-042bbd28-558b-4721-96e5-7245ca03f040 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:53.764012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-042bbd28-558b-4721-96e5-7245ca03f040 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153785 Jun 20 06:34:53.764568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 768/1607] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:53 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:54.781851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-96de074e-1356-46f9-8f25-e8d56ce24eef tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:54.782480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-96de074e-1356-46f9-8f25-e8d56ce24eef tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:54.789638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96de074e-1356-46f9-8f25-e8d56ce24eef tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:54.790109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96de074e-1356-46f9-8f25-e8d56ce24eef tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:54.790870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96de074e-1356-46f9-8f25-e8d56ce24eef tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:54.791305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96de074e-1356-46f9-8f25-e8d56ce24eef tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:54.920584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-96de074e-1356-46f9-8f25-e8d56ce24eef tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:54.928030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-96de074e-1356-46f9-8f25-e8d56ce24eef tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150091 Jun 20 06:34:54.928599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 840/1608] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:55.946291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-add1fe83-9ef5-4282-a54e-b42cdda94888 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:55.946992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-add1fe83-9ef5-4282-a54e-b42cdda94888 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:55.953534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-add1fe83-9ef5-4282-a54e-b42cdda94888 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:55.953980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-add1fe83-9ef5-4282-a54e-b42cdda94888 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:55.954738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-add1fe83-9ef5-4282-a54e-b42cdda94888 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:55.955167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-add1fe83-9ef5-4282-a54e-b42cdda94888 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:56.083020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-add1fe83-9ef5-4282-a54e-b42cdda94888 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:56.090944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-add1fe83-9ef5-4282-a54e-b42cdda94888 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149137 Jun 20 06:34:56.091498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 769/1609] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:57.108103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4c1d5efb-d735-4ff7-a28f-afd9c38ea2bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:57.108742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4c1d5efb-d735-4ff7-a28f-afd9c38ea2bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:57.115134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c1d5efb-d735-4ff7-a28f-afd9c38ea2bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:57.115589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c1d5efb-d735-4ff7-a28f-afd9c38ea2bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:57.116352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c1d5efb-d735-4ff7-a28f-afd9c38ea2bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:57.118150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c1d5efb-d735-4ff7-a28f-afd9c38ea2bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:57.263674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4c1d5efb-d735-4ff7-a28f-afd9c38ea2bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:57.271473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4c1d5efb-d735-4ff7-a28f-afd9c38ea2bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.167306 Jun 20 06:34:57.272034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 841/1610] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:58.287915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3f27bc97-23b6-48d5-ad95-9163a7f878f1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:58.289113 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3f27bc97-23b6-48d5-ad95-9163a7f878f1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:58.295630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f27bc97-23b6-48d5-ad95-9163a7f878f1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:58.296082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f27bc97-23b6-48d5-ad95-9163a7f878f1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:58.296836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f27bc97-23b6-48d5-ad95-9163a7f878f1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:58.297270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f27bc97-23b6-48d5-ad95-9163a7f878f1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:58.320056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:34:58.320706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:34:58.428215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3f27bc97-23b6-48d5-ad95-9163a7f878f1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:58.435716 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3f27bc97-23b6-48d5-ad95-9163a7f878f1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151728 Jun 20 06:34:58.436275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 770/1611] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:34:59.452763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fe08f4be-2c7c-490f-9849-6fd1b1ef50a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:34:59.453372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fe08f4be-2c7c-490f-9849-6fd1b1ef50a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:34:59.459853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe08f4be-2c7c-490f-9849-6fd1b1ef50a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:59.460957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe08f4be-2c7c-490f-9849-6fd1b1ef50a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:59.461932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe08f4be-2c7c-490f-9849-6fd1b1ef50a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:34:59.462369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe08f4be-2c7c-490f-9849-6fd1b1ef50a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:34:59.593172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fe08f4be-2c7c-490f-9849-6fd1b1ef50a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:34:59.600592 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fe08f4be-2c7c-490f-9849-6fd1b1ef50a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151638 Jun 20 06:34:59.602816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 842/1612] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:34:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:00.513602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:35:00.514369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:35:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:35:00.618851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0f26393-dfe3-4f9f-a220-c83e040a2077 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:00.619917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f0f26393-dfe3-4f9f-a220-c83e040a2077 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:00.627015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0f26393-dfe3-4f9f-a220-c83e040a2077 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:00.627464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0f26393-dfe3-4f9f-a220-c83e040a2077 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:00.628216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0f26393-dfe3-4f9f-a220-c83e040a2077 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:00.628650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0f26393-dfe3-4f9f-a220-c83e040a2077 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:00.761365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f0f26393-dfe3-4f9f-a220-c83e040a2077 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:00.769031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f0f26393-dfe3-4f9f-a220-c83e040a2077 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154071 Jun 20 06:35:00.769620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 771/1613] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:01.788094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a4e582bb-6f8d-400d-af9a-3cded2fe5582 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:01.788683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a4e582bb-6f8d-400d-af9a-3cded2fe5582 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:01.795206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4e582bb-6f8d-400d-af9a-3cded2fe5582 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:01.795647 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4e582bb-6f8d-400d-af9a-3cded2fe5582 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:01.796395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4e582bb-6f8d-400d-af9a-3cded2fe5582 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:01.796821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4e582bb-6f8d-400d-af9a-3cded2fe5582 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:01.925294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a4e582bb-6f8d-400d-af9a-3cded2fe5582 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:01.932738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a4e582bb-6f8d-400d-af9a-3cded2fe5582 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.148568 Jun 20 06:35:01.933853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 843/1614] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:02.950799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e3a7013d-ff64-42b4-a58e-670d3536d19b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:02.951359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e3a7013d-ff64-42b4-a58e-670d3536d19b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:02.957953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3a7013d-ff64-42b4-a58e-670d3536d19b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:02.958414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3a7013d-ff64-42b4-a58e-670d3536d19b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:02.959189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3a7013d-ff64-42b4-a58e-670d3536d19b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:02.959630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e3a7013d-ff64-42b4-a58e-670d3536d19b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:03.092646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e3a7013d-ff64-42b4-a58e-670d3536d19b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:03.100193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e3a7013d-ff64-42b4-a58e-670d3536d19b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153564 Jun 20 06:35:03.100756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 772/1615] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:04.117957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-64f9e2ad-c44d-477a-a661-51bb0dfaebdb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:04.118562 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-64f9e2ad-c44d-477a-a661-51bb0dfaebdb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:04.125357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64f9e2ad-c44d-477a-a661-51bb0dfaebdb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:04.125823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64f9e2ad-c44d-477a-a661-51bb0dfaebdb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:04.126568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64f9e2ad-c44d-477a-a661-51bb0dfaebdb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:04.126996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64f9e2ad-c44d-477a-a661-51bb0dfaebdb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:04.257526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-64f9e2ad-c44d-477a-a661-51bb0dfaebdb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:04.265838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-64f9e2ad-c44d-477a-a661-51bb0dfaebdb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151893 Jun 20 06:35:04.266387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 844/1616] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:05.282880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75387aeb-e522-49d6-ba72-6e3fe13abc1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:05.283521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-75387aeb-e522-49d6-ba72-6e3fe13abc1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:05.290003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75387aeb-e522-49d6-ba72-6e3fe13abc1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:05.290449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75387aeb-e522-49d6-ba72-6e3fe13abc1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:05.291203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75387aeb-e522-49d6-ba72-6e3fe13abc1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:05.291637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75387aeb-e522-49d6-ba72-6e3fe13abc1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:05.426168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-75387aeb-e522-49d6-ba72-6e3fe13abc1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:05.433608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-75387aeb-e522-49d6-ba72-6e3fe13abc1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154550 Jun 20 06:35:05.434813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 773/1617] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:06.452106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3ad7e737-7a8f-4b0d-9c7c-119f7828069e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:06.452708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3ad7e737-7a8f-4b0d-9c7c-119f7828069e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:06.459131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ad7e737-7a8f-4b0d-9c7c-119f7828069e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:06.459565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ad7e737-7a8f-4b0d-9c7c-119f7828069e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:06.460322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ad7e737-7a8f-4b0d-9c7c-119f7828069e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:06.460747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ad7e737-7a8f-4b0d-9c7c-119f7828069e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:06.590328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3ad7e737-7a8f-4b0d-9c7c-119f7828069e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:06.598499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3ad7e737-7a8f-4b0d-9c7c-119f7828069e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150723 Jun 20 06:35:06.599053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 845/1618] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:07.615713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-51bea358-bfe9-4f52-b179-95a9697416b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:07.616251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-51bea358-bfe9-4f52-b179-95a9697416b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:07.622914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51bea358-bfe9-4f52-b179-95a9697416b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:07.623361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51bea358-bfe9-4f52-b179-95a9697416b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:07.624112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51bea358-bfe9-4f52-b179-95a9697416b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:07.624543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51bea358-bfe9-4f52-b179-95a9697416b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:07.627044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:07.762250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-51bea358-bfe9-4f52-b179-95a9697416b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:07.770028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-51bea358-bfe9-4f52-b179-95a9697416b6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.158274 Jun 20 06:35:07.770585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 774/1619] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:08.787026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5397c0b2-b929-4dd9-ad72-7be1e42024da tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:08.787634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5397c0b2-b929-4dd9-ad72-7be1e42024da tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:08.794226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5397c0b2-b929-4dd9-ad72-7be1e42024da tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:08.794665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5397c0b2-b929-4dd9-ad72-7be1e42024da tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:08.795417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5397c0b2-b929-4dd9-ad72-7be1e42024da tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:08.795844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5397c0b2-b929-4dd9-ad72-7be1e42024da tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:08.923502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5397c0b2-b929-4dd9-ad72-7be1e42024da tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:08.930971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5397c0b2-b929-4dd9-ad72-7be1e42024da tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.147700 Jun 20 06:35:08.931465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 846/1620] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:09.947598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-84296a7e-c65a-43db-90e2-8a94ce1874ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:09.948237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-84296a7e-c65a-43db-90e2-8a94ce1874ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:09.950572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:09.955736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84296a7e-c65a-43db-90e2-8a94ce1874ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:09.956184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84296a7e-c65a-43db-90e2-8a94ce1874ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:09.956946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84296a7e-c65a-43db-90e2-8a94ce1874ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:09.957413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84296a7e-c65a-43db-90e2-8a94ce1874ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:10.086462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84296a7e-c65a-43db-90e2-8a94ce1874ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:10.094645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-84296a7e-c65a-43db-90e2-8a94ce1874ab tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150962 Jun 20 06:35:10.095206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 775/1621] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:11.110973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b47405b7-bcb0-479f-b58f-f790b8918994 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:11.111521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b47405b7-bcb0-479f-b58f-f790b8918994 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:11.113760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:11.119392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b47405b7-bcb0-479f-b58f-f790b8918994 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:11.119834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b47405b7-bcb0-479f-b58f-f790b8918994 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:11.120584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b47405b7-bcb0-479f-b58f-f790b8918994 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:11.121014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b47405b7-bcb0-479f-b58f-f790b8918994 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:11.123652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=78 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:11.254969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b47405b7-bcb0-479f-b58f-f790b8918994 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:11.262988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b47405b7-bcb0-479f-b58f-f790b8918994 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155289 Jun 20 06:35:11.263658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 847/1622] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:35:12.280878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c1bfb6c-e985-4a24-b099-26a44085c691 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:12.281503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c1bfb6c-e985-4a24-b099-26a44085c691 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:12.288119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c1bfb6c-e985-4a24-b099-26a44085c691 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:12.288562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c1bfb6c-e985-4a24-b099-26a44085c691 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:12.289319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c1bfb6c-e985-4a24-b099-26a44085c691 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:12.289781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c1bfb6c-e985-4a24-b099-26a44085c691 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:12.420784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c1bfb6c-e985-4a24-b099-26a44085c691 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:12.428457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c1bfb6c-e985-4a24-b099-26a44085c691 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152297 Jun 20 06:35:12.429029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 776/1623] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:13.445805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a51f6ba-b551-4f06-bd9b-9f0b0309d8fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:13.446420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2a51f6ba-b551-4f06-bd9b-9f0b0309d8fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:13.453014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a51f6ba-b551-4f06-bd9b-9f0b0309d8fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:13.453499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a51f6ba-b551-4f06-bd9b-9f0b0309d8fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:13.454266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a51f6ba-b551-4f06-bd9b-9f0b0309d8fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:13.454704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a51f6ba-b551-4f06-bd9b-9f0b0309d8fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:13.587700 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2a51f6ba-b551-4f06-bd9b-9f0b0309d8fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:13.595989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2a51f6ba-b551-4f06-bd9b-9f0b0309d8fe tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154040 Jun 20 06:35:13.596547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 848/1624] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:14.612891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7159641a-927a-40ff-b17f-901141d087e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:14.613457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7159641a-927a-40ff-b17f-901141d087e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:14.619487 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7159641a-927a-40ff-b17f-901141d087e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:14.619938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7159641a-927a-40ff-b17f-901141d087e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:14.620703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7159641a-927a-40ff-b17f-901141d087e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:14.621147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7159641a-927a-40ff-b17f-901141d087e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:14.757090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7159641a-927a-40ff-b17f-901141d087e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:14.764498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7159641a-927a-40ff-b17f-901141d087e1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155772 Jun 20 06:35:14.765323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 777/1625] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:15.782413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bafcb95d-2155-4868-b187-19c690674882 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:15.783010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bafcb95d-2155-4868-b187-19c690674882 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:15.789888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bafcb95d-2155-4868-b187-19c690674882 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:15.790327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bafcb95d-2155-4868-b187-19c690674882 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:15.791077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bafcb95d-2155-4868-b187-19c690674882 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:15.791506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bafcb95d-2155-4868-b187-19c690674882 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:15.920548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bafcb95d-2155-4868-b187-19c690674882 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:15.927901 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bafcb95d-2155-4868-b187-19c690674882 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149441 Jun 20 06:35:15.928456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 849/1626] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:15 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:16.944846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4a3f9501-ecd4-4ea8-b9e5-ebdc1a959d89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:16.945439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4a3f9501-ecd4-4ea8-b9e5-ebdc1a959d89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:16.952554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a3f9501-ecd4-4ea8-b9e5-ebdc1a959d89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:16.952998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a3f9501-ecd4-4ea8-b9e5-ebdc1a959d89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:16.953794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a3f9501-ecd4-4ea8-b9e5-ebdc1a959d89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:16.954234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a3f9501-ecd4-4ea8-b9e5-ebdc1a959d89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:17.094164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4a3f9501-ecd4-4ea8-b9e5-ebdc1a959d89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:17.101622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4a3f9501-ecd4-4ea8-b9e5-ebdc1a959d89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.160795 Jun 20 06:35:17.102182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 778/1627] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:18.119438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b679216b-d754-435d-a6f7-1cc0ae284284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:18.120032 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b679216b-d754-435d-a6f7-1cc0ae284284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:18.126887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b679216b-d754-435d-a6f7-1cc0ae284284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:18.127339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b679216b-d754-435d-a6f7-1cc0ae284284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:18.128101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b679216b-d754-435d-a6f7-1cc0ae284284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:18.128537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b679216b-d754-435d-a6f7-1cc0ae284284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:18.258303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b679216b-d754-435d-a6f7-1cc0ae284284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:18.266625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b679216b-d754-435d-a6f7-1cc0ae284284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151150 Jun 20 06:35:18.267189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 850/1628] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:19.284104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ab6873d5-fc7f-49f6-941f-31699ad37917 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:19.284712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ab6873d5-fc7f-49f6-941f-31699ad37917 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:19.291294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab6873d5-fc7f-49f6-941f-31699ad37917 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:19.291738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab6873d5-fc7f-49f6-941f-31699ad37917 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:19.292492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab6873d5-fc7f-49f6-941f-31699ad37917 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:19.292922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab6873d5-fc7f-49f6-941f-31699ad37917 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:19.425465 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ab6873d5-fc7f-49f6-941f-31699ad37917 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:19.432928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ab6873d5-fc7f-49f6-941f-31699ad37917 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152652 Jun 20 06:35:19.433519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 779/1629] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:20.450448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dceea368-e29d-4608-89d6-ca0392033584 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:20.451712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dceea368-e29d-4608-89d6-ca0392033584 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:20.457573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dceea368-e29d-4608-89d6-ca0392033584 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:20.458020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dceea368-e29d-4608-89d6-ca0392033584 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:20.458777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dceea368-e29d-4608-89d6-ca0392033584 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:20.459217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dceea368-e29d-4608-89d6-ca0392033584 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:20.590115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dceea368-e29d-4608-89d6-ca0392033584 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:20.598450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dceea368-e29d-4608-89d6-ca0392033584 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151940 Jun 20 06:35:20.599017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 851/1630] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:21.615616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24046c73-ee3b-47d8-aaac-eca8ffe267b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:21.616177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24046c73-ee3b-47d8-aaac-eca8ffe267b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:21.622670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24046c73-ee3b-47d8-aaac-eca8ffe267b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:21.624321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24046c73-ee3b-47d8-aaac-eca8ffe267b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:21.625099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24046c73-ee3b-47d8-aaac-eca8ffe267b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:21.625566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24046c73-ee3b-47d8-aaac-eca8ffe267b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:21.761766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24046c73-ee3b-47d8-aaac-eca8ffe267b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:21.770089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24046c73-ee3b-47d8-aaac-eca8ffe267b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.158412 Jun 20 06:35:21.770656 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 780/1631] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:22.788070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e0063b6a-503e-48c0-8dbf-ae3199119000 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:22.788675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e0063b6a-503e-48c0-8dbf-ae3199119000 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:22.795745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0063b6a-503e-48c0-8dbf-ae3199119000 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:22.796191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0063b6a-503e-48c0-8dbf-ae3199119000 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:22.796948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0063b6a-503e-48c0-8dbf-ae3199119000 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:22.797401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0063b6a-503e-48c0-8dbf-ae3199119000 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:22.925048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e0063b6a-503e-48c0-8dbf-ae3199119000 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:22.932614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e0063b6a-503e-48c0-8dbf-ae3199119000 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.148441 Jun 20 06:35:22.933115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 852/1632] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:22 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:23.950057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a01ce79e-75a3-4bf1-a6d5-bdf64ca51767 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:23.950704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a01ce79e-75a3-4bf1-a6d5-bdf64ca51767 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:23.958118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a01ce79e-75a3-4bf1-a6d5-bdf64ca51767 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:23.958559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a01ce79e-75a3-4bf1-a6d5-bdf64ca51767 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:23.959539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a01ce79e-75a3-4bf1-a6d5-bdf64ca51767 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:23.959980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a01ce79e-75a3-4bf1-a6d5-bdf64ca51767 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:24.091151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a01ce79e-75a3-4bf1-a6d5-bdf64ca51767 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:24.098636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a01ce79e-75a3-4bf1-a6d5-bdf64ca51767 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152420 Jun 20 06:35:24.099189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 781/1633] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:25.115895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-347c5817-4237-44be-813f-51a25471ff9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:25.116457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-347c5817-4237-44be-813f-51a25471ff9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:25.122833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-347c5817-4237-44be-813f-51a25471ff9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:25.123852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-347c5817-4237-44be-813f-51a25471ff9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:25.124628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-347c5817-4237-44be-813f-51a25471ff9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:25.125054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-347c5817-4237-44be-813f-51a25471ff9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:25.260904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-347c5817-4237-44be-813f-51a25471ff9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:25.269228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-347c5817-4237-44be-813f-51a25471ff9b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.157279 Jun 20 06:35:25.269809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 853/1634] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:25 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:26.286117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-504e8309-f837-4169-9119-a01fe801f37a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:26.286713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-504e8309-f837-4169-9119-a01fe801f37a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:26.293102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-504e8309-f837-4169-9119-a01fe801f37a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:26.293584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-504e8309-f837-4169-9119-a01fe801f37a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:26.294340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-504e8309-f837-4169-9119-a01fe801f37a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:26.295396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-504e8309-f837-4169-9119-a01fe801f37a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:26.427305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-504e8309-f837-4169-9119-a01fe801f37a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:26.434805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-504e8309-f837-4169-9119-a01fe801f37a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152512 Jun 20 06:35:26.435954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 782/1635] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:27.452597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3123b24a-25de-44ee-9450-42d74db77cec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:27.453244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3123b24a-25de-44ee-9450-42d74db77cec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:27.459885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3123b24a-25de-44ee-9450-42d74db77cec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:27.460332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3123b24a-25de-44ee-9450-42d74db77cec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:27.461099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3123b24a-25de-44ee-9450-42d74db77cec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:27.461575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3123b24a-25de-44ee-9450-42d74db77cec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:27.593037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3123b24a-25de-44ee-9450-42d74db77cec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:27.600505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3123b24a-25de-44ee-9450-42d74db77cec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151792 Jun 20 06:35:27.601071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 854/1636] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:27 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:28.618163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1bf8d43e-e792-4a06-8e97-0af4c83fc4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:28.618726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1bf8d43e-e792-4a06-8e97-0af4c83fc4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:28.625696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf8d43e-e792-4a06-8e97-0af4c83fc4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:28.626143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf8d43e-e792-4a06-8e97-0af4c83fc4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:28.626900 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf8d43e-e792-4a06-8e97-0af4c83fc4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:28.627329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1bf8d43e-e792-4a06-8e97-0af4c83fc4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:28.756433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1bf8d43e-e792-4a06-8e97-0af4c83fc4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:28.763867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1bf8d43e-e792-4a06-8e97-0af4c83fc4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149630 Jun 20 06:35:28.764434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 783/1637] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:28 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:29.782398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e1969a45-6abc-4f8b-8d6c-8a8b22c8088a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:29.783012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e1969a45-6abc-4f8b-8d6c-8a8b22c8088a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:29.789525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1969a45-6abc-4f8b-8d6c-8a8b22c8088a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:29.789981 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1969a45-6abc-4f8b-8d6c-8a8b22c8088a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:29.790741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1969a45-6abc-4f8b-8d6c-8a8b22c8088a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:29.791172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1969a45-6abc-4f8b-8d6c-8a8b22c8088a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:29.928806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e1969a45-6abc-4f8b-8d6c-8a8b22c8088a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:29.936216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e1969a45-6abc-4f8b-8d6c-8a8b22c8088a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.158436 Jun 20 06:35:29.937324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 855/1638] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:30.954348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1992fd50-a072-491f-8c83-e11746e40667 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:30.954965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1992fd50-a072-491f-8c83-e11746e40667 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:30.961529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1992fd50-a072-491f-8c83-e11746e40667 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:30.961987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1992fd50-a072-491f-8c83-e11746e40667 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:30.962746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1992fd50-a072-491f-8c83-e11746e40667 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:30.963184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1992fd50-a072-491f-8c83-e11746e40667 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:31.093929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1992fd50-a072-491f-8c83-e11746e40667 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:31.101394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1992fd50-a072-491f-8c83-e11746e40667 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151410 Jun 20 06:35:31.102043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 784/1639] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:32.118560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cd246f88-ca8f-4866-b587-1be046a828ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:32.119167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cd246f88-ca8f-4866-b587-1be046a828ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:32.125800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd246f88-ca8f-4866-b587-1be046a828ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:32.126241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd246f88-ca8f-4866-b587-1be046a828ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:32.126996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd246f88-ca8f-4866-b587-1be046a828ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:32.127425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd246f88-ca8f-4866-b587-1be046a828ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:32.257712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cd246f88-ca8f-4866-b587-1be046a828ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:32.265737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cd246f88-ca8f-4866-b587-1be046a828ec tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150458 Jun 20 06:35:32.266321 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 856/1640] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:32 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:33.282444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6e5bc4c0-91e9-41aa-863a-73017072b24f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:33.283077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6e5bc4c0-91e9-41aa-863a-73017072b24f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:33.289579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e5bc4c0-91e9-41aa-863a-73017072b24f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:33.290031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e5bc4c0-91e9-41aa-863a-73017072b24f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:33.290792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e5bc4c0-91e9-41aa-863a-73017072b24f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:33.291229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e5bc4c0-91e9-41aa-863a-73017072b24f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:33.423443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6e5bc4c0-91e9-41aa-863a-73017072b24f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:33.430911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6e5bc4c0-91e9-41aa-863a-73017072b24f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152458 Jun 20 06:35:33.431480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 785/1641] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:33 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:34.448582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cc6b5538-c777-42c5-bada-46964a0d4401 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:34.449186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cc6b5538-c777-42c5-bada-46964a0d4401 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:34.455174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc6b5538-c777-42c5-bada-46964a0d4401 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:34.455617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc6b5538-c777-42c5-bada-46964a0d4401 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:34.456362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc6b5538-c777-42c5-bada-46964a0d4401 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:34.456789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc6b5538-c777-42c5-bada-46964a0d4401 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:34.587181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cc6b5538-c777-42c5-bada-46964a0d4401 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:34.595041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cc6b5538-c777-42c5-bada-46964a0d4401 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150468 Jun 20 06:35:34.595597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 857/1642] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:35.612325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-078c627b-595f-42aa-8c22-a9748843c575 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:35.612872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-078c627b-595f-42aa-8c22-a9748843c575 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:35.619350 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-078c627b-595f-42aa-8c22-a9748843c575 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:35.619800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-078c627b-595f-42aa-8c22-a9748843c575 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:35.620558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-078c627b-595f-42aa-8c22-a9748843c575 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:35.620993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-078c627b-595f-42aa-8c22-a9748843c575 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:35.752362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-078c627b-595f-42aa-8c22-a9748843c575 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:35.759843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-078c627b-595f-42aa-8c22-a9748843c575 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151660 Jun 20 06:35:35.760413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 786/1643] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:35 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:36.778768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-27870b7e-e255-4c29-96d3-b1c5f6d5fe82 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:36.779378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-27870b7e-e255-4c29-96d3-b1c5f6d5fe82 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:36.786877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27870b7e-e255-4c29-96d3-b1c5f6d5fe82 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:36.787411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27870b7e-e255-4c29-96d3-b1c5f6d5fe82 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:36.788356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27870b7e-e255-4c29-96d3-b1c5f6d5fe82 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:36.788879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27870b7e-e255-4c29-96d3-b1c5f6d5fe82 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:36.917940 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-27870b7e-e255-4c29-96d3-b1c5f6d5fe82 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:36.925671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-27870b7e-e255-4c29-96d3-b1c5f6d5fe82 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150705 Jun 20 06:35:36.926232 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 858/1644] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:37.942526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-053ea59d-b0bc-4aac-8442-75c3423a6535 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:37.943129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-053ea59d-b0bc-4aac-8442-75c3423a6535 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:37.949202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-053ea59d-b0bc-4aac-8442-75c3423a6535 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:37.949671 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-053ea59d-b0bc-4aac-8442-75c3423a6535 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:37.950429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-053ea59d-b0bc-4aac-8442-75c3423a6535 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:37.950858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-053ea59d-b0bc-4aac-8442-75c3423a6535 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:37.953405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:38.086316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-053ea59d-b0bc-4aac-8442-75c3423a6535 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:38.094341 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-053ea59d-b0bc-4aac-8442-75c3423a6535 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155052 Jun 20 06:35:38.095001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 787/1645] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:35:39.112034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1e81c315-d665-4320-ae53-5d490f3d4f35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:39.112581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1e81c315-d665-4320-ae53-5d490f3d4f35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:39.120160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e81c315-d665-4320-ae53-5d490f3d4f35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:39.120803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e81c315-d665-4320-ae53-5d490f3d4f35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:39.121868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e81c315-d665-4320-ae53-5d490f3d4f35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:39.122360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e81c315-d665-4320-ae53-5d490f3d4f35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:39.254859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1e81c315-d665-4320-ae53-5d490f3d4f35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:39.262373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1e81c315-d665-4320-ae53-5d490f3d4f35 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154855 Jun 20 06:35:39.262939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 859/1646] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:39 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:40.280147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-151ffe5f-e75d-4f61-abad-b21275f22a2c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:40.280764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-151ffe5f-e75d-4f61-abad-b21275f22a2c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:40.283599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:40.289006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-151ffe5f-e75d-4f61-abad-b21275f22a2c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:40.289523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-151ffe5f-e75d-4f61-abad-b21275f22a2c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:40.290291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-151ffe5f-e75d-4f61-abad-b21275f22a2c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:40.290729 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-151ffe5f-e75d-4f61-abad-b21275f22a2c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:40.428148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-151ffe5f-e75d-4f61-abad-b21275f22a2c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:40.435607 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-151ffe5f-e75d-4f61-abad-b21275f22a2c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.159316 Jun 20 06:35:40.436169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 788/1647] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:41.452633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-779aa7bc-f289-49d4-9deb-40516916020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:41.453241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-779aa7bc-f289-49d4-9deb-40516916020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:41.456094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:41.461235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-779aa7bc-f289-49d4-9deb-40516916020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:41.461703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-779aa7bc-f289-49d4-9deb-40516916020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:41.462455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-779aa7bc-f289-49d4-9deb-40516916020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:41.462883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-779aa7bc-f289-49d4-9deb-40516916020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:41.465531 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=78 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:35:41.594327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-779aa7bc-f289-49d4-9deb-40516916020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:41.601894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-779aa7bc-f289-49d4-9deb-40516916020e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153113 Jun 20 06:35:41.602487 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 860/1648] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:42.619177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0285f662-c65b-4b3f-9297-ca82b967388a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:42.619757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0285f662-c65b-4b3f-9297-ca82b967388a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:42.626259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0285f662-c65b-4b3f-9297-ca82b967388a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:42.626706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0285f662-c65b-4b3f-9297-ca82b967388a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:42.627459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0285f662-c65b-4b3f-9297-ca82b967388a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:42.628553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0285f662-c65b-4b3f-9297-ca82b967388a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:42.765590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0285f662-c65b-4b3f-9297-ca82b967388a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:42.773500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0285f662-c65b-4b3f-9297-ca82b967388a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.158267 Jun 20 06:35:42.774066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 789/1649] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:42 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:43.790956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea07736b-6eee-4de1-8a10-fc88d00d1e07 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:43.791570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ea07736b-6eee-4de1-8a10-fc88d00d1e07 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:43.798015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea07736b-6eee-4de1-8a10-fc88d00d1e07 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:43.798452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea07736b-6eee-4de1-8a10-fc88d00d1e07 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:43.799197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea07736b-6eee-4de1-8a10-fc88d00d1e07 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:43.799630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea07736b-6eee-4de1-8a10-fc88d00d1e07 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:43.934136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ea07736b-6eee-4de1-8a10-fc88d00d1e07 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:43.941692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ea07736b-6eee-4de1-8a10-fc88d00d1e07 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154745 Jun 20 06:35:43.942253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 861/1650] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:44.958482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3a7d08b4-3365-42ff-ac1c-dc06be4c07ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:44.959021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3a7d08b4-3365-42ff-ac1c-dc06be4c07ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:44.965044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a7d08b4-3365-42ff-ac1c-dc06be4c07ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:44.965516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a7d08b4-3365-42ff-ac1c-dc06be4c07ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:44.966272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a7d08b4-3365-42ff-ac1c-dc06be4c07ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:44.966707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a7d08b4-3365-42ff-ac1c-dc06be4c07ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:45.096749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3a7d08b4-3365-42ff-ac1c-dc06be4c07ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:45.104205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3a7d08b4-3365-42ff-ac1c-dc06be4c07ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149926 Jun 20 06:35:45.104764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 790/1651] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:46.122049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2968c5f7-bb04-43b4-9e9e-161c07fd3f72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:46.122638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2968c5f7-bb04-43b4-9e9e-161c07fd3f72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:46.129006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2968c5f7-bb04-43b4-9e9e-161c07fd3f72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:46.129624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2968c5f7-bb04-43b4-9e9e-161c07fd3f72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:46.130379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2968c5f7-bb04-43b4-9e9e-161c07fd3f72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:46.130807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2968c5f7-bb04-43b4-9e9e-161c07fd3f72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:46.261411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2968c5f7-bb04-43b4-9e9e-161c07fd3f72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:46.269011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2968c5f7-bb04-43b4-9e9e-161c07fd3f72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150817 Jun 20 06:35:46.269600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 862/1652] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:47.289666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fea3c0a0-380f-4595-b83e-40da030a8f38 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:47.290306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fea3c0a0-380f-4595-b83e-40da030a8f38 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:47.296422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea3c0a0-380f-4595-b83e-40da030a8f38 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:47.296875 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea3c0a0-380f-4595-b83e-40da030a8f38 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:47.297669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea3c0a0-380f-4595-b83e-40da030a8f38 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:47.298109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fea3c0a0-380f-4595-b83e-40da030a8f38 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:47.430480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fea3c0a0-380f-4595-b83e-40da030a8f38 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:47.437953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fea3c0a0-380f-4595-b83e-40da030a8f38 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155379 Jun 20 06:35:47.438522 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 791/1653] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:48.455935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a1f82c72-0484-4f3c-960d-e3f2be5c2c99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:48.456603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a1f82c72-0484-4f3c-960d-e3f2be5c2c99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:48.464319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1f82c72-0484-4f3c-960d-e3f2be5c2c99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:48.464883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1f82c72-0484-4f3c-960d-e3f2be5c2c99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:48.465755 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1f82c72-0484-4f3c-960d-e3f2be5c2c99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:48.466187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1f82c72-0484-4f3c-960d-e3f2be5c2c99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:48.594609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a1f82c72-0484-4f3c-960d-e3f2be5c2c99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:48.602264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a1f82c72-0484-4f3c-960d-e3f2be5c2c99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150532 Jun 20 06:35:48.602826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 863/1654] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:49.618924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-840ad70b-27e2-4c0e-8bb1-034949fb427e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:49.619459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-840ad70b-27e2-4c0e-8bb1-034949fb427e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:49.625955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-840ad70b-27e2-4c0e-8bb1-034949fb427e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:49.626396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-840ad70b-27e2-4c0e-8bb1-034949fb427e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:49.627143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-840ad70b-27e2-4c0e-8bb1-034949fb427e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:49.627575 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-840ad70b-27e2-4c0e-8bb1-034949fb427e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:49.761404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-840ad70b-27e2-4c0e-8bb1-034949fb427e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:49.772178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-840ad70b-27e2-4c0e-8bb1-034949fb427e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.157184 Jun 20 06:35:49.772758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 792/1655] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:50.792432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c86c3868-b8dc-4230-a729-10494dee7385 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:50.793036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c86c3868-b8dc-4230-a729-10494dee7385 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:50.799732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c86c3868-b8dc-4230-a729-10494dee7385 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:50.800165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c86c3868-b8dc-4230-a729-10494dee7385 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:50.800921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c86c3868-b8dc-4230-a729-10494dee7385 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:50.801454 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c86c3868-b8dc-4230-a729-10494dee7385 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:50.930291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c86c3868-b8dc-4230-a729-10494dee7385 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:50.937681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c86c3868-b8dc-4230-a729-10494dee7385 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149022 Jun 20 06:35:50.938246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 864/1656] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:51.955019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33ae7e78-23d1-482b-9a38-947dc52c6f75 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:51.955657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-33ae7e78-23d1-482b-9a38-947dc52c6f75 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:51.962311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33ae7e78-23d1-482b-9a38-947dc52c6f75 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:51.962761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33ae7e78-23d1-482b-9a38-947dc52c6f75 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:51.963512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33ae7e78-23d1-482b-9a38-947dc52c6f75 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:51.963952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33ae7e78-23d1-482b-9a38-947dc52c6f75 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:52.101280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-33ae7e78-23d1-482b-9a38-947dc52c6f75 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:52.108759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-33ae7e78-23d1-482b-9a38-947dc52c6f75 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.157628 Jun 20 06:35:52.109324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 793/1657] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:53.125624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-aea97118-bdf4-4a99-81d8-0a267cb21c45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:53.126277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-aea97118-bdf4-4a99-81d8-0a267cb21c45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:53.133297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aea97118-bdf4-4a99-81d8-0a267cb21c45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:53.133766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aea97118-bdf4-4a99-81d8-0a267cb21c45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:53.134545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aea97118-bdf4-4a99-81d8-0a267cb21c45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:53.134997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aea97118-bdf4-4a99-81d8-0a267cb21c45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:53.267492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-aea97118-bdf4-4a99-81d8-0a267cb21c45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:53.274869 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-aea97118-bdf4-4a99-81d8-0a267cb21c45 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153083 Jun 20 06:35:53.275429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 865/1658] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:53 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:54.292540 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e623cb2-a800-469b-8bbf-e5dd5ea82fb7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:54.293155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5e623cb2-a800-469b-8bbf-e5dd5ea82fb7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:54.299761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e623cb2-a800-469b-8bbf-e5dd5ea82fb7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:54.300215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e623cb2-a800-469b-8bbf-e5dd5ea82fb7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:54.300970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e623cb2-a800-469b-8bbf-e5dd5ea82fb7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:54.301428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e623cb2-a800-469b-8bbf-e5dd5ea82fb7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:54.432389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e623cb2-a800-469b-8bbf-e5dd5ea82fb7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:54.439842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e623cb2-a800-469b-8bbf-e5dd5ea82fb7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151181 Jun 20 06:35:54.440528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 794/1659] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:55.457835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3047a400-c93e-4745-9df0-0e531df2d4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:55.458983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3047a400-c93e-4745-9df0-0e531df2d4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:55.465579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3047a400-c93e-4745-9df0-0e531df2d4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:55.466021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3047a400-c93e-4745-9df0-0e531df2d4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:55.466766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3047a400-c93e-4745-9df0-0e531df2d4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:55.467190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3047a400-c93e-4745-9df0-0e531df2d4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:55.599771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3047a400-c93e-4745-9df0-0e531df2d4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:55.607384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3047a400-c93e-4745-9df0-0e531df2d4df tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153441 Jun 20 06:35:55.607951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 866/1660] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:56.624141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c7b6128-5299-4ed8-8c12-57eaf20580ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:56.624676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c7b6128-5299-4ed8-8c12-57eaf20580ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:56.631211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c7b6128-5299-4ed8-8c12-57eaf20580ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:56.631666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c7b6128-5299-4ed8-8c12-57eaf20580ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:56.632445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c7b6128-5299-4ed8-8c12-57eaf20580ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:56.632886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c7b6128-5299-4ed8-8c12-57eaf20580ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:56.765490 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c7b6128-5299-4ed8-8c12-57eaf20580ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:56.773877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c7b6128-5299-4ed8-8c12-57eaf20580ae tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153660 Jun 20 06:35:56.774445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 795/1661] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:57.791594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-03c8d86f-cf9b-4c55-b7be-b81529d753a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:57.792203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-03c8d86f-cf9b-4c55-b7be-b81529d753a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:57.798621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03c8d86f-cf9b-4c55-b7be-b81529d753a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:57.799058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03c8d86f-cf9b-4c55-b7be-b81529d753a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:57.799810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03c8d86f-cf9b-4c55-b7be-b81529d753a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:57.800238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03c8d86f-cf9b-4c55-b7be-b81529d753a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:57.934226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-03c8d86f-cf9b-4c55-b7be-b81529d753a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:57.941630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-03c8d86f-cf9b-4c55-b7be-b81529d753a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153877 Jun 20 06:35:57.942193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 867/1662] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:35:58.959913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6e75769d-574b-4ed9-9665-37cd714c59eb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:35:58.960459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6e75769d-574b-4ed9-9665-37cd714c59eb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:35:58.966888 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e75769d-574b-4ed9-9665-37cd714c59eb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:58.967343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e75769d-574b-4ed9-9665-37cd714c59eb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:58.968096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e75769d-574b-4ed9-9665-37cd714c59eb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:35:58.968532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e75769d-574b-4ed9-9665-37cd714c59eb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:35:59.097504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6e75769d-574b-4ed9-9665-37cd714c59eb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:35:59.105628 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6e75769d-574b-4ed9-9665-37cd714c59eb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150274 Jun 20 06:35:59.106203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 796/1663] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:35:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:00.122720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6eb0c1fe-0c62-4346-b372-cc087419b49f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:00.123327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6eb0c1fe-0c62-4346-b372-cc087419b49f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:00.129773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6eb0c1fe-0c62-4346-b372-cc087419b49f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:00.130264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6eb0c1fe-0c62-4346-b372-cc087419b49f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:00.131077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6eb0c1fe-0c62-4346-b372-cc087419b49f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:00.131508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6eb0c1fe-0c62-4346-b372-cc087419b49f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:00.261896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6eb0c1fe-0c62-4346-b372-cc087419b49f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:00.269688 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6eb0c1fe-0c62-4346-b372-cc087419b49f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150839 Jun 20 06:36:00.270252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 868/1664] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:01.288099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8345d42e-35c3-4fe2-9cc4-e65bca2ad85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:01.288681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8345d42e-35c3-4fe2-9cc4-e65bca2ad85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:01.295088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8345d42e-35c3-4fe2-9cc4-e65bca2ad85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:01.295542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8345d42e-35c3-4fe2-9cc4-e65bca2ad85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:01.296290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8345d42e-35c3-4fe2-9cc4-e65bca2ad85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:01.296721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8345d42e-35c3-4fe2-9cc4-e65bca2ad85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:01.426261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8345d42e-35c3-4fe2-9cc4-e65bca2ad85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:01.433616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8345d42e-35c3-4fe2-9cc4-e65bca2ad85f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150102 Jun 20 06:36:01.434175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 797/1665] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:02.451395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1b61d1c7-f323-4e04-ba97-ef9f3d56d41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:02.451998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1b61d1c7-f323-4e04-ba97-ef9f3d56d41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:02.458483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b61d1c7-f323-4e04-ba97-ef9f3d56d41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:02.458923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b61d1c7-f323-4e04-ba97-ef9f3d56d41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:02.459665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b61d1c7-f323-4e04-ba97-ef9f3d56d41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:02.460090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b61d1c7-f323-4e04-ba97-ef9f3d56d41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:02.588052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1b61d1c7-f323-4e04-ba97-ef9f3d56d41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:02.595484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1b61d1c7-f323-4e04-ba97-ef9f3d56d41e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.147878 Jun 20 06:36:02.596059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 869/1666] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:03.612825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7e0027c8-f57d-4879-a9cf-2fc0d25ed1fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:03.613416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7e0027c8-f57d-4879-a9cf-2fc0d25ed1fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:03.620977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e0027c8-f57d-4879-a9cf-2fc0d25ed1fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:03.621449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e0027c8-f57d-4879-a9cf-2fc0d25ed1fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:03.622214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e0027c8-f57d-4879-a9cf-2fc0d25ed1fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:03.622668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e0027c8-f57d-4879-a9cf-2fc0d25ed1fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:03.755498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7e0027c8-f57d-4879-a9cf-2fc0d25ed1fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:03.763354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7e0027c8-f57d-4879-a9cf-2fc0d25ed1fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154457 Jun 20 06:36:03.764030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 798/1667] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:04.781536 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-836d9f27-cba0-45d5-a3fa-ee790f2a8fbf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:04.782152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-836d9f27-cba0-45d5-a3fa-ee790f2a8fbf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:04.788178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-836d9f27-cba0-45d5-a3fa-ee790f2a8fbf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:04.788717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-836d9f27-cba0-45d5-a3fa-ee790f2a8fbf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:04.789563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-836d9f27-cba0-45d5-a3fa-ee790f2a8fbf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:04.790000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-836d9f27-cba0-45d5-a3fa-ee790f2a8fbf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:04.918856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-836d9f27-cba0-45d5-a3fa-ee790f2a8fbf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:04.926326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-836d9f27-cba0-45d5-a3fa-ee790f2a8fbf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.148834 Jun 20 06:36:04.926888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 870/1668] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:05.944019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d47f11a9-8f0a-4f1b-a88b-46a9991f198e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:05.944627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d47f11a9-8f0a-4f1b-a88b-46a9991f198e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:05.951942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d47f11a9-8f0a-4f1b-a88b-46a9991f198e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:05.952393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d47f11a9-8f0a-4f1b-a88b-46a9991f198e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:05.953151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d47f11a9-8f0a-4f1b-a88b-46a9991f198e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:05.953608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d47f11a9-8f0a-4f1b-a88b-46a9991f198e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:06.084605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d47f11a9-8f0a-4f1b-a88b-46a9991f198e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:06.092248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d47f11a9-8f0a-4f1b-a88b-46a9991f198e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152071 Jun 20 06:36:06.092811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 799/1669] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:07.109564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3dc27b36-2162-407d-9871-80768b3ab3a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:07.110115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3dc27b36-2162-407d-9871-80768b3ab3a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:07.116575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3dc27b36-2162-407d-9871-80768b3ab3a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:07.117051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3dc27b36-2162-407d-9871-80768b3ab3a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:07.117842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3dc27b36-2162-407d-9871-80768b3ab3a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:07.118284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3dc27b36-2162-407d-9871-80768b3ab3a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:07.243882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3dc27b36-2162-407d-9871-80768b3ab3a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:07.251390 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3dc27b36-2162-407d-9871-80768b3ab3a4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.145770 Jun 20 06:36:07.251954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 871/1670] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:08.269233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f65e6d6c-35af-4342-b56e-af21055f704d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:08.269859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f65e6d6c-35af-4342-b56e-af21055f704d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:08.276458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65e6d6c-35af-4342-b56e-af21055f704d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:08.276909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65e6d6c-35af-4342-b56e-af21055f704d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:08.277692 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65e6d6c-35af-4342-b56e-af21055f704d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:08.278131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65e6d6c-35af-4342-b56e-af21055f704d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:08.280625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:08.408090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f65e6d6c-35af-4342-b56e-af21055f704d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:08.416092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f65e6d6c-35af-4342-b56e-af21055f704d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150716 Jun 20 06:36:08.416657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 800/1671] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:09.432839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-65333c7b-b7f4-476d-b806-1f875f83f3fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:09.433470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-65333c7b-b7f4-476d-b806-1f875f83f3fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:09.440596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65333c7b-b7f4-476d-b806-1f875f83f3fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:09.441294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65333c7b-b7f4-476d-b806-1f875f83f3fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:09.442084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65333c7b-b7f4-476d-b806-1f875f83f3fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:09.442518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65333c7b-b7f4-476d-b806-1f875f83f3fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:09.815074 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-65333c7b-b7f4-476d-b806-1f875f83f3fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:09.822989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-65333c7b-b7f4-476d-b806-1f875f83f3fa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.393985 Jun 20 06:36:09.823551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 872/1672] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:10.840784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9a705527-1b80-4a6c-9bcf-66b20b1bb790 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:10.841413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9a705527-1b80-4a6c-9bcf-66b20b1bb790 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:10.843718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:10.848946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a705527-1b80-4a6c-9bcf-66b20b1bb790 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:10.849413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a705527-1b80-4a6c-9bcf-66b20b1bb790 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:10.850180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a705527-1b80-4a6c-9bcf-66b20b1bb790 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:10.850616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a705527-1b80-4a6c-9bcf-66b20b1bb790 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:10.979512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a705527-1b80-4a6c-9bcf-66b20b1bb790 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:10.986967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9a705527-1b80-4a6c-9bcf-66b20b1bb790 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150072 Jun 20 06:36:10.987524 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 801/1673] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:10 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:12.003495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-39259390-0298-4d41-8801-9618fd6aa01b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:12.004095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-39259390-0298-4d41-8801-9618fd6aa01b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:12.006397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:12.012848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39259390-0298-4d41-8801-9618fd6aa01b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:12.013291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39259390-0298-4d41-8801-9618fd6aa01b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:12.014104 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39259390-0298-4d41-8801-9618fd6aa01b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:12.014771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39259390-0298-4d41-8801-9618fd6aa01b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:12.017286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=78 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:12.152838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-39259390-0298-4d41-8801-9618fd6aa01b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:12.160282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-39259390-0298-4d41-8801-9618fd6aa01b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.160635 Jun 20 06:36:12.160843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 873/1674] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:13.177316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-57a85285-5c54-4835-b72b-f64e687b7ce4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:13.177937 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-57a85285-5c54-4835-b72b-f64e687b7ce4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:13.185267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57a85285-5c54-4835-b72b-f64e687b7ce4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:13.185810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57a85285-5c54-4835-b72b-f64e687b7ce4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:13.186573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57a85285-5c54-4835-b72b-f64e687b7ce4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:13.187008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57a85285-5c54-4835-b72b-f64e687b7ce4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:13.317940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-57a85285-5c54-4835-b72b-f64e687b7ce4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:13.325955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-57a85285-5c54-4835-b72b-f64e687b7ce4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152537 Jun 20 06:36:13.326528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 802/1675] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:14.343472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0a1bd418-7b43-41f5-bbfa-9fec2126ee1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:14.344087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0a1bd418-7b43-41f5-bbfa-9fec2126ee1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:14.350733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a1bd418-7b43-41f5-bbfa-9fec2126ee1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:14.351281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a1bd418-7b43-41f5-bbfa-9fec2126ee1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:14.352613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a1bd418-7b43-41f5-bbfa-9fec2126ee1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:14.353049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a1bd418-7b43-41f5-bbfa-9fec2126ee1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:14.488599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0a1bd418-7b43-41f5-bbfa-9fec2126ee1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:14.496557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0a1bd418-7b43-41f5-bbfa-9fec2126ee1f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.156904 Jun 20 06:36:14.497111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 874/1676] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:15.513843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d19833e1-3e48-4c86-9ef0-8601c7d80ffd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:15.514446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d19833e1-3e48-4c86-9ef0-8601c7d80ffd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:15.520644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d19833e1-3e48-4c86-9ef0-8601c7d80ffd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:15.521086 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d19833e1-3e48-4c86-9ef0-8601c7d80ffd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:15.521860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d19833e1-3e48-4c86-9ef0-8601c7d80ffd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:15.522289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d19833e1-3e48-4c86-9ef0-8601c7d80ffd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:15.649062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d19833e1-3e48-4c86-9ef0-8601c7d80ffd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:15.656379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d19833e1-3e48-4c86-9ef0-8601c7d80ffd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.146594 Jun 20 06:36:15.656940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 803/1677] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:15 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:16.672881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c546ccc8-d26f-4bc0-8bbf-abcd1e7bd79b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:16.673533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c546ccc8-d26f-4bc0-8bbf-abcd1e7bd79b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:16.680475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c546ccc8-d26f-4bc0-8bbf-abcd1e7bd79b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:16.680934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c546ccc8-d26f-4bc0-8bbf-abcd1e7bd79b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:16.681688 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c546ccc8-d26f-4bc0-8bbf-abcd1e7bd79b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:16.682119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c546ccc8-d26f-4bc0-8bbf-abcd1e7bd79b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:16.812266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c546ccc8-d26f-4bc0-8bbf-abcd1e7bd79b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:16.819638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c546ccc8-d26f-4bc0-8bbf-abcd1e7bd79b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150583 Jun 20 06:36:16.820798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 875/1678] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:17.837714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bd1a396-9c48-4387-8623-a22499bef07b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:17.838355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7bd1a396-9c48-4387-8623-a22499bef07b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:17.844813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bd1a396-9c48-4387-8623-a22499bef07b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:17.845256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bd1a396-9c48-4387-8623-a22499bef07b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:17.846048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bd1a396-9c48-4387-8623-a22499bef07b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:17.846474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bd1a396-9c48-4387-8623-a22499bef07b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:17.975415 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bd1a396-9c48-4387-8623-a22499bef07b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:17.983546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bd1a396-9c48-4387-8623-a22499bef07b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150337 Jun 20 06:36:17.984116 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 804/1679] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:17 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:19.000125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c6874176-88f2-4b60-bd5b-e625f2926127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:19.000671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c6874176-88f2-4b60-bd5b-e625f2926127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:19.007236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6874176-88f2-4b60-bd5b-e625f2926127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:19.007911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6874176-88f2-4b60-bd5b-e625f2926127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:19.008665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6874176-88f2-4b60-bd5b-e625f2926127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:19.009166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6874176-88f2-4b60-bd5b-e625f2926127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:19.145777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c6874176-88f2-4b60-bd5b-e625f2926127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:19.154104 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c6874176-88f2-4b60-bd5b-e625f2926127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.157896 Jun 20 06:36:19.154663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 876/1680] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:20.091163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:36:20.091855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:36:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:36:20.171322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24c23fad-9c4c-42dd-9770-76369285b975 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:20.171927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24c23fad-9c4c-42dd-9770-76369285b975 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:20.178663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24c23fad-9c4c-42dd-9770-76369285b975 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:20.179118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24c23fad-9c4c-42dd-9770-76369285b975 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:20.180454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24c23fad-9c4c-42dd-9770-76369285b975 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:20.180882 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24c23fad-9c4c-42dd-9770-76369285b975 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:20.313769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24c23fad-9c4c-42dd-9770-76369285b975 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:20.321778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24c23fad-9c4c-42dd-9770-76369285b975 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154440 Jun 20 06:36:20.322348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 805/1681] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:21.339391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f53ca2d-0f87-40f3-89a7-1891aa1584f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:21.340091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f53ca2d-0f87-40f3-89a7-1891aa1584f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:21.347648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f53ca2d-0f87-40f3-89a7-1891aa1584f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:21.348089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f53ca2d-0f87-40f3-89a7-1891aa1584f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:21.348836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f53ca2d-0f87-40f3-89a7-1891aa1584f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:21.349261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f53ca2d-0f87-40f3-89a7-1891aa1584f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:21.478724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7f53ca2d-0f87-40f3-89a7-1891aa1584f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:21.486324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f53ca2d-0f87-40f3-89a7-1891aa1584f2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151181 Jun 20 06:36:21.486994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 877/1682] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:22.503841 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-999b2b78-a60f-4496-a26d-cbc77b20b795 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:22.504488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-999b2b78-a60f-4496-a26d-cbc77b20b795 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:22.512576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-999b2b78-a60f-4496-a26d-cbc77b20b795 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:22.513222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-999b2b78-a60f-4496-a26d-cbc77b20b795 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:22.514100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-999b2b78-a60f-4496-a26d-cbc77b20b795 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:22.514794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-999b2b78-a60f-4496-a26d-cbc77b20b795 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:22.647290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-999b2b78-a60f-4496-a26d-cbc77b20b795 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:22.655160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-999b2b78-a60f-4496-a26d-cbc77b20b795 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155219 Jun 20 06:36:22.655724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 806/1683] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:22 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:23.673296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bdef623a-36d4-475a-b402-583c09b7f8fd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:23.674095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bdef623a-36d4-475a-b402-583c09b7f8fd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:23.681063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bdef623a-36d4-475a-b402-583c09b7f8fd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:23.681551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bdef623a-36d4-475a-b402-583c09b7f8fd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:23.682317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bdef623a-36d4-475a-b402-583c09b7f8fd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:23.682976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bdef623a-36d4-475a-b402-583c09b7f8fd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:23.812310 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bdef623a-36d4-475a-b402-583c09b7f8fd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:23.819800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bdef623a-36d4-475a-b402-583c09b7f8fd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150987 Jun 20 06:36:23.820366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 878/1684] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:24.838025 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4b876746-068b-4b5d-a827-3741fe109feb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:24.838731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4b876746-068b-4b5d-a827-3741fe109feb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:24.846945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b876746-068b-4b5d-a827-3741fe109feb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:24.847549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b876746-068b-4b5d-a827-3741fe109feb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:24.848367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b876746-068b-4b5d-a827-3741fe109feb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:24.848828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b876746-068b-4b5d-a827-3741fe109feb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:24.981640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4b876746-068b-4b5d-a827-3741fe109feb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:24.989087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4b876746-068b-4b5d-a827-3741fe109feb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155162 Jun 20 06:36:24.989683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 807/1685] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:24 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:26.007958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-97672f99-edad-4831-822f-dc8f7ec7e768 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:26.008545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-97672f99-edad-4831-822f-dc8f7ec7e768 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:26.016031 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97672f99-edad-4831-822f-dc8f7ec7e768 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:26.016688 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97672f99-edad-4831-822f-dc8f7ec7e768 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:26.017858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97672f99-edad-4831-822f-dc8f7ec7e768 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:26.018434 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-97672f99-edad-4831-822f-dc8f7ec7e768 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:26.153985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-97672f99-edad-4831-822f-dc8f7ec7e768 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:26.161481 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-97672f99-edad-4831-822f-dc8f7ec7e768 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.157311 Jun 20 06:36:26.162018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 879/1686] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:27.180356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9c44a6d0-f413-4df8-ae35-e90222738566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:27.180951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9c44a6d0-f413-4df8-ae35-e90222738566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:27.187750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c44a6d0-f413-4df8-ae35-e90222738566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:27.188202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c44a6d0-f413-4df8-ae35-e90222738566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:27.188973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c44a6d0-f413-4df8-ae35-e90222738566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:27.189425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c44a6d0-f413-4df8-ae35-e90222738566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:27.324255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9c44a6d0-f413-4df8-ae35-e90222738566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:27.332451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9c44a6d0-f413-4df8-ae35-e90222738566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155493 Jun 20 06:36:27.332594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 808/1687] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:27 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:28.350781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d8e4b4f6-c65e-4ef3-badf-07d56f1db138 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:28.351390 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d8e4b4f6-c65e-4ef3-badf-07d56f1db138 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:28.359947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8e4b4f6-c65e-4ef3-badf-07d56f1db138 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:28.360459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8e4b4f6-c65e-4ef3-badf-07d56f1db138 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:28.361370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8e4b4f6-c65e-4ef3-badf-07d56f1db138 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:28.361918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d8e4b4f6-c65e-4ef3-badf-07d56f1db138 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:28.497244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d8e4b4f6-c65e-4ef3-badf-07d56f1db138 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:28.504874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d8e4b4f6-c65e-4ef3-badf-07d56f1db138 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.158417 Jun 20 06:36:28.505459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 880/1688] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:28 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:29.522992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-04f38102-aebb-48af-82b7-9feb30e9ab0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:29.523554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-04f38102-aebb-48af-82b7-9feb30e9ab0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:29.530094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04f38102-aebb-48af-82b7-9feb30e9ab0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:29.530542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04f38102-aebb-48af-82b7-9feb30e9ab0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:29.531301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04f38102-aebb-48af-82b7-9feb30e9ab0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:29.531738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04f38102-aebb-48af-82b7-9feb30e9ab0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:29.662161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-04f38102-aebb-48af-82b7-9feb30e9ab0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:29.670220 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-04f38102-aebb-48af-82b7-9feb30e9ab0d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150534 Jun 20 06:36:29.670942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 809/1689] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:30.688175 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-923c2c36-9b63-4bec-bdb5-b8c3e24370d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:30.688826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-923c2c36-9b63-4bec-bdb5-b8c3e24370d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:30.695735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-923c2c36-9b63-4bec-bdb5-b8c3e24370d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:30.696178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-923c2c36-9b63-4bec-bdb5-b8c3e24370d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:30.696931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-923c2c36-9b63-4bec-bdb5-b8c3e24370d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:30.697358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-923c2c36-9b63-4bec-bdb5-b8c3e24370d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:30.834202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-923c2c36-9b63-4bec-bdb5-b8c3e24370d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:30.842119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-923c2c36-9b63-4bec-bdb5-b8c3e24370d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.158132 Jun 20 06:36:30.842686 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 881/1690] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:31.859877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f6bfeec2-40f3-4abd-9a8c-fd9908ad07bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:31.860492 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f6bfeec2-40f3-4abd-9a8c-fd9908ad07bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:31.866979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6bfeec2-40f3-4abd-9a8c-fd9908ad07bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:31.867435 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6bfeec2-40f3-4abd-9a8c-fd9908ad07bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:31.868196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6bfeec2-40f3-4abd-9a8c-fd9908ad07bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:31.868632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6bfeec2-40f3-4abd-9a8c-fd9908ad07bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:31.998743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6bfeec2-40f3-4abd-9a8c-fd9908ad07bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:32.006421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f6bfeec2-40f3-4abd-9a8c-fd9908ad07bc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.151017 Jun 20 06:36:32.006987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 810/1691] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:31 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:33.024639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e7a2e4a3-923e-47a7-ab5f-314883be3469 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:33.025197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e7a2e4a3-923e-47a7-ab5f-314883be3469 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:33.031249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7a2e4a3-923e-47a7-ab5f-314883be3469 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:33.031692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7a2e4a3-923e-47a7-ab5f-314883be3469 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:33.032440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7a2e4a3-923e-47a7-ab5f-314883be3469 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:33.032868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7a2e4a3-923e-47a7-ab5f-314883be3469 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:33.161106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e7a2e4a3-923e-47a7-ab5f-314883be3469 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:33.168773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e7a2e4a3-923e-47a7-ab5f-314883be3469 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.148020 Jun 20 06:36:33.169331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 882/1692] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:33 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:34.185149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c36211f2-b497-4939-af7b-ea8e23ef3945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:34.185781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c36211f2-b497-4939-af7b-ea8e23ef3945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:34.192218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c36211f2-b497-4939-af7b-ea8e23ef3945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:34.192660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c36211f2-b497-4939-af7b-ea8e23ef3945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:34.193440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c36211f2-b497-4939-af7b-ea8e23ef3945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:34.193872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c36211f2-b497-4939-af7b-ea8e23ef3945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:34.326352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c36211f2-b497-4939-af7b-ea8e23ef3945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:34.334840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c36211f2-b497-4939-af7b-ea8e23ef3945 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153441 Jun 20 06:36:34.335400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 811/1693] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:35.352034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7bbe77f5-21c9-4192-99de-8a9c19a7d97f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:35.352651 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7bbe77f5-21c9-4192-99de-8a9c19a7d97f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:35.359841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7bbe77f5-21c9-4192-99de-8a9c19a7d97f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:35.360298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7bbe77f5-21c9-4192-99de-8a9c19a7d97f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:35.361071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7bbe77f5-21c9-4192-99de-8a9c19a7d97f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:35.361549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7bbe77f5-21c9-4192-99de-8a9c19a7d97f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:35.490259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7bbe77f5-21c9-4192-99de-8a9c19a7d97f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:35.498001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7bbe77f5-21c9-4192-99de-8a9c19a7d97f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149791 Jun 20 06:36:35.498660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 883/1694] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:35 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:36.515719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f30d63da-1768-4eab-89ce-e83e89d3eaac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:36.516321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f30d63da-1768-4eab-89ce-e83e89d3eaac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:36.522808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f30d63da-1768-4eab-89ce-e83e89d3eaac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:36.523252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f30d63da-1768-4eab-89ce-e83e89d3eaac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:36.524002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f30d63da-1768-4eab-89ce-e83e89d3eaac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:36.524435 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f30d63da-1768-4eab-89ce-e83e89d3eaac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:36.657959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f30d63da-1768-4eab-89ce-e83e89d3eaac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:36.665622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f30d63da-1768-4eab-89ce-e83e89d3eaac tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154559 Jun 20 06:36:36.666180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 812/1695] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:37.682824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-241142d8-9c3f-4bd9-b0a2-835bf170575a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:37.683435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-241142d8-9c3f-4bd9-b0a2-835bf170575a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:37.690779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-241142d8-9c3f-4bd9-b0a2-835bf170575a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:37.691328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-241142d8-9c3f-4bd9-b0a2-835bf170575a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:37.692074 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-241142d8-9c3f-4bd9-b0a2-835bf170575a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:37.692520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-241142d8-9c3f-4bd9-b0a2-835bf170575a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:37.823577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-241142d8-9c3f-4bd9-b0a2-835bf170575a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:37.831213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-241142d8-9c3f-4bd9-b0a2-835bf170575a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152197 Jun 20 06:36:37.831782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 884/1696] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:38.849158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bed58c4c-bb6f-4aa3-8256-3657d4404371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:38.849842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bed58c4c-bb6f-4aa3-8256-3657d4404371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:38.856273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bed58c4c-bb6f-4aa3-8256-3657d4404371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:38.856721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bed58c4c-bb6f-4aa3-8256-3657d4404371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:38.857516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bed58c4c-bb6f-4aa3-8256-3657d4404371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:38.858440 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bed58c4c-bb6f-4aa3-8256-3657d4404371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:38.862342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:38.990769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bed58c4c-bb6f-4aa3-8256-3657d4404371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:38.998805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bed58c4c-bb6f-4aa3-8256-3657d4404371 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153075 Jun 20 06:36:38.999373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 813/1697] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:38 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:40.016426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3cfd8ebb-43e8-4c4f-b0d8-9d24b671d47e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:40.017038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3cfd8ebb-43e8-4c4f-b0d8-9d24b671d47e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:40.023418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3cfd8ebb-43e8-4c4f-b0d8-9d24b671d47e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:40.023862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3cfd8ebb-43e8-4c4f-b0d8-9d24b671d47e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:40.024617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3cfd8ebb-43e8-4c4f-b0d8-9d24b671d47e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:40.025044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3cfd8ebb-43e8-4c4f-b0d8-9d24b671d47e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:40.158435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3cfd8ebb-43e8-4c4f-b0d8-9d24b671d47e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:40.165935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3cfd8ebb-43e8-4c4f-b0d8-9d24b671d47e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154293 Jun 20 06:36:40.166498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 885/1698] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:41.183722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-edb4c948-1d80-48e6-9283-023f3c061dd4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:41.184340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-edb4c948-1d80-48e6-9283-023f3c061dd4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:41.187355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:41.192648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edb4c948-1d80-48e6-9283-023f3c061dd4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:41.193101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edb4c948-1d80-48e6-9283-023f3c061dd4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:41.193899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edb4c948-1d80-48e6-9283-023f3c061dd4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:41.194342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edb4c948-1d80-48e6-9283-023f3c061dd4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:41.324947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-edb4c948-1d80-48e6-9283-023f3c061dd4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:41.332625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-edb4c948-1d80-48e6-9283-023f3c061dd4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152764 Jun 20 06:36:41.333209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 814/1699] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:42.350355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f80aa806-2084-4e9d-8f1c-7af12f930ef2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:42.351083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f80aa806-2084-4e9d-8f1c-7af12f930ef2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:42.353452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:42.359600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f80aa806-2084-4e9d-8f1c-7af12f930ef2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:42.360101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f80aa806-2084-4e9d-8f1c-7af12f930ef2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:42.360965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f80aa806-2084-4e9d-8f1c-7af12f930ef2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:42.361415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f80aa806-2084-4e9d-8f1c-7af12f930ef2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:42.366405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=78 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:42.495891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f80aa806-2084-4e9d-8f1c-7af12f930ef2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:42.504144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f80aa806-2084-4e9d-8f1c-7af12f930ef2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.157751 Jun 20 06:36:42.504697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 886/1700] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:42 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:43.521596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a231d0e8-1400-4f30-aa31-908088263789 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:43.522228 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a231d0e8-1400-4f30-aa31-908088263789 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:43.528706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a231d0e8-1400-4f30-aa31-908088263789 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:43.529156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a231d0e8-1400-4f30-aa31-908088263789 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:43.530644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a231d0e8-1400-4f30-aa31-908088263789 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:43.531080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a231d0e8-1400-4f30-aa31-908088263789 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:43.662528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a231d0e8-1400-4f30-aa31-908088263789 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:43.670641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a231d0e8-1400-4f30-aa31-908088263789 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152380 Jun 20 06:36:43.671189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 815/1701] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:44.688414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6f496103-02a6-4a67-b1d4-14cb8824587c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:44.689041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6f496103-02a6-4a67-b1d4-14cb8824587c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:44.695507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f496103-02a6-4a67-b1d4-14cb8824587c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:44.695947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f496103-02a6-4a67-b1d4-14cb8824587c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:44.696694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f496103-02a6-4a67-b1d4-14cb8824587c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:44.697122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f496103-02a6-4a67-b1d4-14cb8824587c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:44.832334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6f496103-02a6-4a67-b1d4-14cb8824587c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:44.839844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6f496103-02a6-4a67-b1d4-14cb8824587c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.156015 Jun 20 06:36:44.844007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 887/1702] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:45.858650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ec09404a-85f4-48c2-a479-de5eceae35d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:45.859281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec09404a-85f4-48c2-a479-de5eceae35d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:45.865501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec09404a-85f4-48c2-a479-de5eceae35d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:45.865955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec09404a-85f4-48c2-a479-de5eceae35d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:45.866720 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec09404a-85f4-48c2-a479-de5eceae35d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:45.867251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec09404a-85f4-48c2-a479-de5eceae35d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:46.001555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ec09404a-85f4-48c2-a479-de5eceae35d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:46.008994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ec09404a-85f4-48c2-a479-de5eceae35d8 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154873 Jun 20 06:36:46.009854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 816/1703] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:47.029082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-27d66662-2268-4fcc-8670-c4318340e1dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:47.030406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-27d66662-2268-4fcc-8670-c4318340e1dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:47.040933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27d66662-2268-4fcc-8670-c4318340e1dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:47.041418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27d66662-2268-4fcc-8670-c4318340e1dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:47.042502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27d66662-2268-4fcc-8670-c4318340e1dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:47.042951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27d66662-2268-4fcc-8670-c4318340e1dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:47.172238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-27d66662-2268-4fcc-8670-c4318340e1dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:47.179631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-27d66662-2268-4fcc-8670-c4318340e1dc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155773 Jun 20 06:36:47.180196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 888/1704] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:48.196590 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4693aab6-938e-4a65-a53a-88e3a3d5c4ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:48.197190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4693aab6-938e-4a65-a53a-88e3a3d5c4ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:48.203740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4693aab6-938e-4a65-a53a-88e3a3d5c4ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:48.204181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4693aab6-938e-4a65-a53a-88e3a3d5c4ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:48.204965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4693aab6-938e-4a65-a53a-88e3a3d5c4ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:48.205417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4693aab6-938e-4a65-a53a-88e3a3d5c4ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:48.337890 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4693aab6-938e-4a65-a53a-88e3a3d5c4ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:48.345956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4693aab6-938e-4a65-a53a-88e3a3d5c4ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.153208 Jun 20 06:36:48.346517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 817/1705] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:49.363307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bf0a7cbd-bbd0-4c05-a4f2-0abfa54ac68c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:49.363922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bf0a7cbd-bbd0-4c05-a4f2-0abfa54ac68c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:49.370551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf0a7cbd-bbd0-4c05-a4f2-0abfa54ac68c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:49.371001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf0a7cbd-bbd0-4c05-a4f2-0abfa54ac68c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:49.371763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf0a7cbd-bbd0-4c05-a4f2-0abfa54ac68c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:49.372201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf0a7cbd-bbd0-4c05-a4f2-0abfa54ac68c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:49.506842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bf0a7cbd-bbd0-4c05-a4f2-0abfa54ac68c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:49.515672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bf0a7cbd-bbd0-4c05-a4f2-0abfa54ac68c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.156083 Jun 20 06:36:49.516552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 889/1706] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:50.533175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9f1b7d28-e587-43ed-8d20-21fd15e9eda5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:50.533811 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9f1b7d28-e587-43ed-8d20-21fd15e9eda5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:50.540308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f1b7d28-e587-43ed-8d20-21fd15e9eda5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:50.540753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f1b7d28-e587-43ed-8d20-21fd15e9eda5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:50.541548 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f1b7d28-e587-43ed-8d20-21fd15e9eda5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:50.541982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f1b7d28-e587-43ed-8d20-21fd15e9eda5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:50.676037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9f1b7d28-e587-43ed-8d20-21fd15e9eda5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:50.683571 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9f1b7d28-e587-43ed-8d20-21fd15e9eda5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.154596 Jun 20 06:36:50.684140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 818/1707] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:51.702759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4afa1a9c-b777-484a-beb2-d6d07eefd1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:51.703358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4afa1a9c-b777-484a-beb2-d6d07eefd1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:51.709881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4afa1a9c-b777-484a-beb2-d6d07eefd1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:51.710328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4afa1a9c-b777-484a-beb2-d6d07eefd1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:51.711087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4afa1a9c-b777-484a-beb2-d6d07eefd1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:51.711521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4afa1a9c-b777-484a-beb2-d6d07eefd1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:51.840282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4afa1a9c-b777-484a-beb2-d6d07eefd1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:51.848732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4afa1a9c-b777-484a-beb2-d6d07eefd1d7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.149880 Jun 20 06:36:51.849300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 890/1708] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:52.866372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2922fbb2-8438-45f1-b791-bee5eb86ee22 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:52.866982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2922fbb2-8438-45f1-b791-bee5eb86ee22 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:52.875387 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2922fbb2-8438-45f1-b791-bee5eb86ee22 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:52.875979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2922fbb2-8438-45f1-b791-bee5eb86ee22 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:52.876830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2922fbb2-8438-45f1-b791-bee5eb86ee22 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:52.877263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2922fbb2-8438-45f1-b791-bee5eb86ee22 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:53.012137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2922fbb2-8438-45f1-b791-bee5eb86ee22 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:53.020604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2922fbb2-8438-45f1-b791-bee5eb86ee22 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.157878 Jun 20 06:36:53.021257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 819/1709] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:54.038192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-42d3e003-8ad8-4646-84c0-edaa4a76bb95 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:54.038794 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-42d3e003-8ad8-4646-84c0-edaa4a76bb95 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:54.045801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42d3e003-8ad8-4646-84c0-edaa4a76bb95 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:54.046239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42d3e003-8ad8-4646-84c0-edaa4a76bb95 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:54.047111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42d3e003-8ad8-4646-84c0-edaa4a76bb95 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:54.047601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42d3e003-8ad8-4646-84c0-edaa4a76bb95 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:54.177200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-42d3e003-8ad8-4646-84c0-edaa4a76bb95 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:54.184575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-42d3e003-8ad8-4646-84c0-edaa4a76bb95 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.150286 Jun 20 06:36:54.185128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 891/1710] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:55.201810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8dff3f64-d930-400c-8c6d-ba797409fe6f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:55.202457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8dff3f64-d930-400c-8c6d-ba797409fe6f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:55.209204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8dff3f64-d930-400c-8c6d-ba797409fe6f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:55.209687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8dff3f64-d930-400c-8c6d-ba797409fe6f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:55.210446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8dff3f64-d930-400c-8c6d-ba797409fe6f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:55.210883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8dff3f64-d930-400c-8c6d-ba797409fe6f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:55.341982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8dff3f64-d930-400c-8c6d-ba797409fe6f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:55.350561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8dff3f64-d930-400c-8c6d-ba797409fe6f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.152728 Jun 20 06:36:55.351128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 820/1711] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:56.367945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-420c3fa1-2e9a-4152-b032-452eb48641a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:56.368553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-420c3fa1-2e9a-4152-b032-452eb48641a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:56.375391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-420c3fa1-2e9a-4152-b032-452eb48641a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:56.375835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-420c3fa1-2e9a-4152-b032-452eb48641a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:56.377119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-420c3fa1-2e9a-4152-b032-452eb48641a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:56.377867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-420c3fa1-2e9a-4152-b032-452eb48641a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:56.511976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-420c3fa1-2e9a-4152-b032-452eb48641a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:56.519740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-420c3fa1-2e9a-4152-b032-452eb48641a3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.155890 Jun 20 06:36:56.520308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 892/1712] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:57.536742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-648f86d9-c8fd-4496-94ef-51d0d2ecd970 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:57.537412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-648f86d9-c8fd-4496-94ef-51d0d2ecd970 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:57.543962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-648f86d9-c8fd-4496-94ef-51d0d2ecd970 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:57.544488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-648f86d9-c8fd-4496-94ef-51d0d2ecd970 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:57.545329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-648f86d9-c8fd-4496-94ef-51d0d2ecd970 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:57.545851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-648f86d9-c8fd-4496-94ef-51d0d2ecd970 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:57.762336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-648f86d9-c8fd-4496-94ef-51d0d2ecd970 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:57.770357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-648f86d9-c8fd-4496-94ef-51d0d2ecd970 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1449 microversion: 2.1 time: 0.238236 Jun 20 06:36:57.770937 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 821/1713] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1449 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:58.186274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-1b58ca5e-3bc6-4d6d-994d-221b9533c260 req-619879cb-5982-4280-b572-483e89692da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0ade09-352b-4eb4-8c02-2bc3e8ed1c19", "name": "network-vif-deleted", "tag": "c0a4dc40-28c7-4749-ab81-fe55f9a8c0da"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:36:58.195712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-1b58ca5e-3bc6-4d6d-994d-221b9533c260 req-619879cb-5982-4280-b572-483e89692da1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:58.196155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-1b58ca5e-3bc6-4d6d-994d-221b9533c260 req-619879cb-5982-4280-b572-483e89692da1 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:58.207027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-1b58ca5e-3bc6-4d6d-994d-221b9533c260 req-619879cb-5982-4280-b572-483e89692da1 service nova] Creating event network-vif-deleted:c0a4dc40-28c7-4749-ab81-fe55f9a8c0da for instance df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 on hv-cinder-80473 Jun 20 06:36:58.212935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-1b58ca5e-3bc6-4d6d-994d-221b9533c260 req-619879cb-5982-4280-b572-483e89692da1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127951 Jun 20 06:36:58.213542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 893/1714] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:36:58.788016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d057f2ff-89ef-4278-9494-201c7ca5e566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:58.788622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d057f2ff-89ef-4278-9494-201c7ca5e566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:58.795089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d057f2ff-89ef-4278-9494-201c7ca5e566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:58.795542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d057f2ff-89ef-4278-9494-201c7ca5e566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:58.796304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d057f2ff-89ef-4278-9494-201c7ca5e566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:58.796736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d057f2ff-89ef-4278-9494-201c7ca5e566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:58.864040 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d057f2ff-89ef-4278-9494-201c7ca5e566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:58.872119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d057f2ff-89ef-4278-9494-201c7ca5e566 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.087894 Jun 20 06:36:58.872775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 822/1715] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:36:59.892616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4d74150d-899b-4c0d-ad9a-c8352f1a57af tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:36:59.893454 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4d74150d-899b-4c0d-ad9a-c8352f1a57af tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:36:59.900173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d74150d-899b-4c0d-ad9a-c8352f1a57af tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:59.900620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d74150d-899b-4c0d-ad9a-c8352f1a57af tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:59.901402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d74150d-899b-4c0d-ad9a-c8352f1a57af tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:36:59.901827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d74150d-899b-4c0d-ad9a-c8352f1a57af tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:36:59.967065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4d74150d-899b-4c0d-ad9a-c8352f1a57af tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:36:59.975111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4d74150d-899b-4c0d-ad9a-c8352f1a57af tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.087107 Jun 20 06:36:59.975667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 894/1716] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:36:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:00.992451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c663b14e-ca38-419c-a0fc-2372fdd2d127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:00.993022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c663b14e-ca38-419c-a0fc-2372fdd2d127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:00.999583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c663b14e-ca38-419c-a0fc-2372fdd2d127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:01.000044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c663b14e-ca38-419c-a0fc-2372fdd2d127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:01.000816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c663b14e-ca38-419c-a0fc-2372fdd2d127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:01.001257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c663b14e-ca38-419c-a0fc-2372fdd2d127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:01.066976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c663b14e-ca38-419c-a0fc-2372fdd2d127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:01.074719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c663b14e-ca38-419c-a0fc-2372fdd2d127 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.086192 Jun 20 06:37:01.075289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 823/1717] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:02.092473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-90812055-f2b3-47a9-8121-c4333455a3c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:02.093079 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-90812055-f2b3-47a9-8121-c4333455a3c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:02.099927 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90812055-f2b3-47a9-8121-c4333455a3c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:02.100393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90812055-f2b3-47a9-8121-c4333455a3c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:02.101143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90812055-f2b3-47a9-8121-c4333455a3c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:02.101609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90812055-f2b3-47a9-8121-c4333455a3c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:02.162085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-90812055-f2b3-47a9-8121-c4333455a3c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:02.169803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-90812055-f2b3-47a9-8121-c4333455a3c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081565 Jun 20 06:37:02.170361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 895/1718] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:03.185775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d61b692b-360c-4f8c-b344-3288b5bbab3d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:03.186380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d61b692b-360c-4f8c-b344-3288b5bbab3d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:03.193088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d61b692b-360c-4f8c-b344-3288b5bbab3d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:03.193573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d61b692b-360c-4f8c-b344-3288b5bbab3d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:03.194328 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d61b692b-360c-4f8c-b344-3288b5bbab3d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:03.194762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d61b692b-360c-4f8c-b344-3288b5bbab3d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:03.258555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d61b692b-360c-4f8c-b344-3288b5bbab3d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:03.266433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d61b692b-360c-4f8c-b344-3288b5bbab3d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084461 Jun 20 06:37:03.266994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 824/1719] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:04.283760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-13cfd3d3-92b6-435e-9967-9e3ae8aa42cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:04.284367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-13cfd3d3-92b6-435e-9967-9e3ae8aa42cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:04.291008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13cfd3d3-92b6-435e-9967-9e3ae8aa42cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:04.291448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13cfd3d3-92b6-435e-9967-9e3ae8aa42cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:04.292199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13cfd3d3-92b6-435e-9967-9e3ae8aa42cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:04.292628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13cfd3d3-92b6-435e-9967-9e3ae8aa42cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:04.356873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-13cfd3d3-92b6-435e-9967-9e3ae8aa42cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:04.365097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-13cfd3d3-92b6-435e-9967-9e3ae8aa42cd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084451 Jun 20 06:37:04.365836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 896/1720] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:04 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:05.382129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-11517663-45b4-4393-ac1b-4596fdac4cde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:05.382750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-11517663-45b4-4393-ac1b-4596fdac4cde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:05.389247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11517663-45b4-4393-ac1b-4596fdac4cde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:05.389992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11517663-45b4-4393-ac1b-4596fdac4cde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:05.390763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11517663-45b4-4393-ac1b-4596fdac4cde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:05.391206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11517663-45b4-4393-ac1b-4596fdac4cde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:05.454063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-11517663-45b4-4393-ac1b-4596fdac4cde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:05.462134 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-11517663-45b4-4393-ac1b-4596fdac4cde tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083964 Jun 20 06:37:05.462697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 825/1721] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:37:06.479575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3c8edcc1-c8b6-4097-a344-7e50ab64ae60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:06.480187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3c8edcc1-c8b6-4097-a344-7e50ab64ae60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:06.486661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c8edcc1-c8b6-4097-a344-7e50ab64ae60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:06.487109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c8edcc1-c8b6-4097-a344-7e50ab64ae60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:06.487867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c8edcc1-c8b6-4097-a344-7e50ab64ae60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:06.488298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c8edcc1-c8b6-4097-a344-7e50ab64ae60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:06.549640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3c8edcc1-c8b6-4097-a344-7e50ab64ae60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:06.557711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3c8edcc1-c8b6-4097-a344-7e50ab64ae60 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082192 Jun 20 06:37:06.558273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 897/1722] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:07.575288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a1a8588d-d053-4169-9ebd-577757ec828f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:07.575896 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a1a8588d-d053-4169-9ebd-577757ec828f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:07.582491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1a8588d-d053-4169-9ebd-577757ec828f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:07.582884 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1a8588d-d053-4169-9ebd-577757ec828f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:07.583688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1a8588d-d053-4169-9ebd-577757ec828f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:07.584123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1a8588d-d053-4169-9ebd-577757ec828f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:07.645691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a1a8588d-d053-4169-9ebd-577757ec828f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:07.653815 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a1a8588d-d053-4169-9ebd-577757ec828f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082573 Jun 20 06:37:07.654370 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 826/1723] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:08.670777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-aace544a-1db2-4b4d-9d3d-4f6718b99e25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:08.671378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-aace544a-1db2-4b4d-9d3d-4f6718b99e25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:08.678905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aace544a-1db2-4b4d-9d3d-4f6718b99e25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:08.679340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aace544a-1db2-4b4d-9d3d-4f6718b99e25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:08.680302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aace544a-1db2-4b4d-9d3d-4f6718b99e25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:08.680734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aace544a-1db2-4b4d-9d3d-4f6718b99e25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:08.742471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-aace544a-1db2-4b4d-9d3d-4f6718b99e25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:08.749935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-aace544a-1db2-4b4d-9d3d-4f6718b99e25 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083218 Jun 20 06:37:08.750490 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 898/1724] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:09.766872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-714da227-bf18-4eda-9f25-7008314e7787 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:09.767495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-714da227-bf18-4eda-9f25-7008314e7787 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:09.774574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-714da227-bf18-4eda-9f25-7008314e7787 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:09.775016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-714da227-bf18-4eda-9f25-7008314e7787 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:09.775766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-714da227-bf18-4eda-9f25-7008314e7787 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:09.776199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-714da227-bf18-4eda-9f25-7008314e7787 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:09.780215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:09.941316 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-714da227-bf18-4eda-9f25-7008314e7787 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:09.949195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-714da227-bf18-4eda-9f25-7008314e7787 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.186327 Jun 20 06:37:09.949862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 827/1725] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:10.967485 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c96abaa-1fda-4e0a-ab41-e273fe3b697c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:10.968095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c96abaa-1fda-4e0a-ab41-e273fe3b697c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:10.975330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c96abaa-1fda-4e0a-ab41-e273fe3b697c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:10.975778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c96abaa-1fda-4e0a-ab41-e273fe3b697c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:10.976543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c96abaa-1fda-4e0a-ab41-e273fe3b697c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:10.976977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c96abaa-1fda-4e0a-ab41-e273fe3b697c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:11.091461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c96abaa-1fda-4e0a-ab41-e273fe3b697c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:11.098878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c96abaa-1fda-4e0a-ab41-e273fe3b697c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.135395 Jun 20 06:37:11.099645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 899/1726] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:10 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:12.116037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91b77029-4237-41bc-a633-5ef3732a3096 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:12.116683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91b77029-4237-41bc-a633-5ef3732a3096 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:12.118978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:12.124282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91b77029-4237-41bc-a633-5ef3732a3096 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:12.124728 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91b77029-4237-41bc-a633-5ef3732a3096 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:12.125511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91b77029-4237-41bc-a633-5ef3732a3096 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:12.125945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91b77029-4237-41bc-a633-5ef3732a3096 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:12.188991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-91b77029-4237-41bc-a633-5ef3732a3096 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:12.197100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91b77029-4237-41bc-a633-5ef3732a3096 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084885 Jun 20 06:37:12.197689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 828/1727] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:13.213603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f55e098e-ca65-4132-b883-1432d4d16454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:13.214220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f55e098e-ca65-4132-b883-1432d4d16454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:13.216675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:13.222194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f55e098e-ca65-4132-b883-1432d4d16454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:13.222641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f55e098e-ca65-4132-b883-1432d4d16454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:13.223405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f55e098e-ca65-4132-b883-1432d4d16454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:13.223837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f55e098e-ca65-4132-b883-1432d4d16454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:13.228678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=80 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:13.285127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f55e098e-ca65-4132-b883-1432d4d16454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:13.293146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f55e098e-ca65-4132-b883-1432d4d16454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083690 Jun 20 06:37:13.293747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 900/1728] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:14.311089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-caa82b59-acfb-476c-b8a3-aca88adcddf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:14.311701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-caa82b59-acfb-476c-b8a3-aca88adcddf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:14.318326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caa82b59-acfb-476c-b8a3-aca88adcddf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:14.318766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caa82b59-acfb-476c-b8a3-aca88adcddf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:14.320183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caa82b59-acfb-476c-b8a3-aca88adcddf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:14.320706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-caa82b59-acfb-476c-b8a3-aca88adcddf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:14.385862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-caa82b59-acfb-476c-b8a3-aca88adcddf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:14.393709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-caa82b59-acfb-476c-b8a3-aca88adcddf6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.086418 Jun 20 06:37:14.394274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 829/1729] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:15.410652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-374ba036-212f-466e-9876-c14dca6fa903 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:15.411264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-374ba036-212f-466e-9876-c14dca6fa903 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:15.418273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-374ba036-212f-466e-9876-c14dca6fa903 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:15.418716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-374ba036-212f-466e-9876-c14dca6fa903 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:15.419479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-374ba036-212f-466e-9876-c14dca6fa903 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:15.419915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-374ba036-212f-466e-9876-c14dca6fa903 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:15.481575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-374ba036-212f-466e-9876-c14dca6fa903 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:15.489058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-374ba036-212f-466e-9876-c14dca6fa903 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082309 Jun 20 06:37:15.489660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 901/1730] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:15 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:16.506424 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3ac0336a-49ce-4a44-96c4-efdc1ecbe959 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:16.507072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3ac0336a-49ce-4a44-96c4-efdc1ecbe959 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:16.513431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ac0336a-49ce-4a44-96c4-efdc1ecbe959 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:16.513889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ac0336a-49ce-4a44-96c4-efdc1ecbe959 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:16.514916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ac0336a-49ce-4a44-96c4-efdc1ecbe959 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:16.515356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ac0336a-49ce-4a44-96c4-efdc1ecbe959 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:16.575716 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3ac0336a-49ce-4a44-96c4-efdc1ecbe959 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:16.583261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3ac0336a-49ce-4a44-96c4-efdc1ecbe959 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080690 Jun 20 06:37:16.583766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 830/1731] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:17.600199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-366302b9-f9c6-461f-a9ae-d064f0fc0791 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:17.600779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-366302b9-f9c6-461f-a9ae-d064f0fc0791 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:17.607733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-366302b9-f9c6-461f-a9ae-d064f0fc0791 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:17.608185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-366302b9-f9c6-461f-a9ae-d064f0fc0791 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:17.608948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-366302b9-f9c6-461f-a9ae-d064f0fc0791 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:17.609416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-366302b9-f9c6-461f-a9ae-d064f0fc0791 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:17.669408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-366302b9-f9c6-461f-a9ae-d064f0fc0791 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:17.676825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-366302b9-f9c6-461f-a9ae-d064f0fc0791 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080658 Jun 20 06:37:17.677396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 902/1732] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:17 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:18.694502 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c5824db7-21a4-4ad4-81a4-aad5deff9c81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:18.695247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c5824db7-21a4-4ad4-81a4-aad5deff9c81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:18.702554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c5824db7-21a4-4ad4-81a4-aad5deff9c81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:18.703017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c5824db7-21a4-4ad4-81a4-aad5deff9c81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:18.703789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c5824db7-21a4-4ad4-81a4-aad5deff9c81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:18.704236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c5824db7-21a4-4ad4-81a4-aad5deff9c81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:18.769205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c5824db7-21a4-4ad4-81a4-aad5deff9c81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:18.776688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c5824db7-21a4-4ad4-81a4-aad5deff9c81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.086070 Jun 20 06:37:18.777242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 831/1733] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:19.794518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-39505edd-692f-45cc-b192-2573eff2a418 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:19.795271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-39505edd-692f-45cc-b192-2573eff2a418 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:19.801695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39505edd-692f-45cc-b192-2573eff2a418 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:19.802196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39505edd-692f-45cc-b192-2573eff2a418 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:19.803045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39505edd-692f-45cc-b192-2573eff2a418 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:19.803475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39505edd-692f-45cc-b192-2573eff2a418 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:19.863360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-39505edd-692f-45cc-b192-2573eff2a418 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:19.871113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-39505edd-692f-45cc-b192-2573eff2a418 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081545 Jun 20 06:37:19.871773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 903/1734] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:20.887541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-858f709d-95d0-4236-863c-eb335c9c3400 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:20.888149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-858f709d-95d0-4236-863c-eb335c9c3400 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:20.894932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-858f709d-95d0-4236-863c-eb335c9c3400 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:20.895379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-858f709d-95d0-4236-863c-eb335c9c3400 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:20.896131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-858f709d-95d0-4236-863c-eb335c9c3400 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:20.896563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-858f709d-95d0-4236-863c-eb335c9c3400 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:20.957495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-858f709d-95d0-4236-863c-eb335c9c3400 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:20.965951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-858f709d-95d0-4236-863c-eb335c9c3400 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082307 Jun 20 06:37:20.966515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 832/1735] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:21.982998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9ef463cd-77c0-43d1-8474-c42d4818eefd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:21.983637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9ef463cd-77c0-43d1-8474-c42d4818eefd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:21.990303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ef463cd-77c0-43d1-8474-c42d4818eefd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:21.990753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ef463cd-77c0-43d1-8474-c42d4818eefd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:21.991501 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ef463cd-77c0-43d1-8474-c42d4818eefd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:21.991953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ef463cd-77c0-43d1-8474-c42d4818eefd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:22.052077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9ef463cd-77c0-43d1-8474-c42d4818eefd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:22.060193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9ef463cd-77c0-43d1-8474-c42d4818eefd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081250 Jun 20 06:37:22.060749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 904/1736] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:23.076551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-185c7fbe-f933-4ba7-b640-7597ba188358 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:23.077168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-185c7fbe-f933-4ba7-b640-7597ba188358 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:23.083700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-185c7fbe-f933-4ba7-b640-7597ba188358 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:23.084156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-185c7fbe-f933-4ba7-b640-7597ba188358 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:23.084961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-185c7fbe-f933-4ba7-b640-7597ba188358 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:23.085414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-185c7fbe-f933-4ba7-b640-7597ba188358 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:23.151220 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-185c7fbe-f933-4ba7-b640-7597ba188358 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:23.158957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-185c7fbe-f933-4ba7-b640-7597ba188358 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.086290 Jun 20 06:37:23.159518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 833/1737] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:24.176101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ca372593-9b71-4db5-8b7f-0cedf76fb913 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:24.176712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ca372593-9b71-4db5-8b7f-0cedf76fb913 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:24.183053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca372593-9b71-4db5-8b7f-0cedf76fb913 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:24.183492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca372593-9b71-4db5-8b7f-0cedf76fb913 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:24.184244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca372593-9b71-4db5-8b7f-0cedf76fb913 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:24.184673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca372593-9b71-4db5-8b7f-0cedf76fb913 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:24.247209 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ca372593-9b71-4db5-8b7f-0cedf76fb913 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:24.254607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ca372593-9b71-4db5-8b7f-0cedf76fb913 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082428 Jun 20 06:37:24.255168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 905/1738] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:24 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:25.272400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c1e0dcea-b3cc-4070-9458-395889a4874e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:25.273139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c1e0dcea-b3cc-4070-9458-395889a4874e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:25.280697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1e0dcea-b3cc-4070-9458-395889a4874e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:25.281146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1e0dcea-b3cc-4070-9458-395889a4874e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:25.281951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1e0dcea-b3cc-4070-9458-395889a4874e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:25.282392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1e0dcea-b3cc-4070-9458-395889a4874e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:25.344580 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c1e0dcea-b3cc-4070-9458-395889a4874e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:25.352125 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c1e0dcea-b3cc-4070-9458-395889a4874e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083611 Jun 20 06:37:25.352688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 834/1739] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:25 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:26.368373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-375b3f43-c76e-4afd-a609-675a521720ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:26.368985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-375b3f43-c76e-4afd-a609-675a521720ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:26.376026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-375b3f43-c76e-4afd-a609-675a521720ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:26.376470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-375b3f43-c76e-4afd-a609-675a521720ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:26.377709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-375b3f43-c76e-4afd-a609-675a521720ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:26.377709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-375b3f43-c76e-4afd-a609-675a521720ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:26.439091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-375b3f43-c76e-4afd-a609-675a521720ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:26.446677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-375b3f43-c76e-4afd-a609-675a521720ee tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082155 Jun 20 06:37:26.447234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 906/1740] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:27.464458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fbdc940c-c9b5-4b80-90dc-a265a2922305 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:27.465082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fbdc940c-c9b5-4b80-90dc-a265a2922305 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:27.471911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbdc940c-c9b5-4b80-90dc-a265a2922305 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:27.472359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbdc940c-c9b5-4b80-90dc-a265a2922305 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:27.473128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbdc940c-c9b5-4b80-90dc-a265a2922305 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:27.473610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fbdc940c-c9b5-4b80-90dc-a265a2922305 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:27.539244 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fbdc940c-c9b5-4b80-90dc-a265a2922305 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:27.547584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fbdc940c-c9b5-4b80-90dc-a265a2922305 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.087202 Jun 20 06:37:27.548151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 835/1741] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:27 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:28.565327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d1b74809-40d1-4e2d-9dac-5b96d95b604d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:28.565973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d1b74809-40d1-4e2d-9dac-5b96d95b604d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:28.572564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1b74809-40d1-4e2d-9dac-5b96d95b604d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:28.574231 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1b74809-40d1-4e2d-9dac-5b96d95b604d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:28.574985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1b74809-40d1-4e2d-9dac-5b96d95b604d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:28.575418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1b74809-40d1-4e2d-9dac-5b96d95b604d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:28.649247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d1b74809-40d1-4e2d-9dac-5b96d95b604d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:28.659529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d1b74809-40d1-4e2d-9dac-5b96d95b604d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.098669 Jun 20 06:37:28.660113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 907/1742] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:28 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:29.677123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f315f75d-687c-4258-a413-1248d105fb5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:29.677755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f315f75d-687c-4258-a413-1248d105fb5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:29.684828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f315f75d-687c-4258-a413-1248d105fb5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:29.685269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f315f75d-687c-4258-a413-1248d105fb5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:29.686044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f315f75d-687c-4258-a413-1248d105fb5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:29.686476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f315f75d-687c-4258-a413-1248d105fb5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:29.745931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f315f75d-687c-4258-a413-1248d105fb5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:29.753330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f315f75d-687c-4258-a413-1248d105fb5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080064 Jun 20 06:37:29.753952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 836/1743] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:30.769976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-86cc7006-1cb7-4539-af7a-1228aff6d993 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:30.770585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-86cc7006-1cb7-4539-af7a-1228aff6d993 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:30.777569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86cc7006-1cb7-4539-af7a-1228aff6d993 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:30.778013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86cc7006-1cb7-4539-af7a-1228aff6d993 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:30.778764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86cc7006-1cb7-4539-af7a-1228aff6d993 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:30.779194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86cc7006-1cb7-4539-af7a-1228aff6d993 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:30.841965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-86cc7006-1cb7-4539-af7a-1228aff6d993 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:30.849719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-86cc7006-1cb7-4539-af7a-1228aff6d993 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083512 Jun 20 06:37:30.850269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 908/1744] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:31.867224 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4514b799-d511-452d-82b5-7f775821dc80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:31.867838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4514b799-d511-452d-82b5-7f775821dc80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:31.875441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4514b799-d511-452d-82b5-7f775821dc80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:31.875892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4514b799-d511-452d-82b5-7f775821dc80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:31.876656 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4514b799-d511-452d-82b5-7f775821dc80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:31.877089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4514b799-d511-452d-82b5-7f775821dc80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:31.938164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4514b799-d511-452d-82b5-7f775821dc80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:31.945634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4514b799-d511-452d-82b5-7f775821dc80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082289 Jun 20 06:37:31.946196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 837/1745] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:31 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:32.963279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6b8f6462-9001-4dfc-879a-c634f0f60463 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:32.964003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6b8f6462-9001-4dfc-879a-c634f0f60463 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:32.970347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b8f6462-9001-4dfc-879a-c634f0f60463 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:32.970796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b8f6462-9001-4dfc-879a-c634f0f60463 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:32.971555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b8f6462-9001-4dfc-879a-c634f0f60463 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:32.971990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b8f6462-9001-4dfc-879a-c634f0f60463 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:33.033215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6b8f6462-9001-4dfc-879a-c634f0f60463 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:33.040898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6b8f6462-9001-4dfc-879a-c634f0f60463 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081509 Jun 20 06:37:33.041478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 909/1746] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:32 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:34.056922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-29146e19-0018-4fe1-b5f9-4e5787e50b5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:34.057589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-29146e19-0018-4fe1-b5f9-4e5787e50b5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:34.064046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29146e19-0018-4fe1-b5f9-4e5787e50b5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:34.064488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29146e19-0018-4fe1-b5f9-4e5787e50b5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:34.065241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29146e19-0018-4fe1-b5f9-4e5787e50b5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:34.065703 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29146e19-0018-4fe1-b5f9-4e5787e50b5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:34.125297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-29146e19-0018-4fe1-b5f9-4e5787e50b5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:34.132600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-29146e19-0018-4fe1-b5f9-4e5787e50b5a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.079521 Jun 20 06:37:34.133157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 838/1747] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:35.150095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2ddbdf13-18ee-403c-b1a0-1d56debca5e9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:35.150710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2ddbdf13-18ee-403c-b1a0-1d56debca5e9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:35.159067 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ddbdf13-18ee-403c-b1a0-1d56debca5e9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:35.159520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ddbdf13-18ee-403c-b1a0-1d56debca5e9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:35.160277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ddbdf13-18ee-403c-b1a0-1d56debca5e9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:35.160714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ddbdf13-18ee-403c-b1a0-1d56debca5e9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:35.224530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2ddbdf13-18ee-403c-b1a0-1d56debca5e9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:35.233053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2ddbdf13-18ee-403c-b1a0-1d56debca5e9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.086785 Jun 20 06:37:35.233639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 910/1748] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:35 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:36.250474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-88cd812b-af68-4345-b13d-ca0fbdba6c04 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:36.251082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-88cd812b-af68-4345-b13d-ca0fbdba6c04 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:36.257643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88cd812b-af68-4345-b13d-ca0fbdba6c04 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:36.258095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88cd812b-af68-4345-b13d-ca0fbdba6c04 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:36.258846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88cd812b-af68-4345-b13d-ca0fbdba6c04 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:36.259275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88cd812b-af68-4345-b13d-ca0fbdba6c04 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:36.321140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-88cd812b-af68-4345-b13d-ca0fbdba6c04 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:36.328933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-88cd812b-af68-4345-b13d-ca0fbdba6c04 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082263 Jun 20 06:37:36.329531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 839/1749] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:37.345653 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b6fbc544-0687-4044-832e-89a3f098d76b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:37.346280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b6fbc544-0687-4044-832e-89a3f098d76b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:37.353086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b6fbc544-0687-4044-832e-89a3f098d76b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:37.353565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b6fbc544-0687-4044-832e-89a3f098d76b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:37.354345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b6fbc544-0687-4044-832e-89a3f098d76b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:37.354776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b6fbc544-0687-4044-832e-89a3f098d76b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:37.419256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b6fbc544-0687-4044-832e-89a3f098d76b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:37.426673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b6fbc544-0687-4044-832e-89a3f098d76b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084925 Jun 20 06:37:37.427238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 911/1750] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:38.443992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-56c81bd0-28b7-4d22-8c5b-853fefac3c17 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:38.444600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-56c81bd0-28b7-4d22-8c5b-853fefac3c17 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:38.451431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56c81bd0-28b7-4d22-8c5b-853fefac3c17 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:38.451961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56c81bd0-28b7-4d22-8c5b-853fefac3c17 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:38.453001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56c81bd0-28b7-4d22-8c5b-853fefac3c17 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:38.453506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56c81bd0-28b7-4d22-8c5b-853fefac3c17 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:38.513961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-56c81bd0-28b7-4d22-8c5b-853fefac3c17 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:38.521599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-56c81bd0-28b7-4d22-8c5b-853fefac3c17 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081435 Jun 20 06:37:38.522158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 840/1751] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:38 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:39.538685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-52b28e12-bd4c-46d6-9219-32b6c549f16f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:39.539300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-52b28e12-bd4c-46d6-9219-32b6c549f16f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:39.546507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b28e12-bd4c-46d6-9219-32b6c549f16f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:39.546958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b28e12-bd4c-46d6-9219-32b6c549f16f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:39.547717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b28e12-bd4c-46d6-9219-32b6c549f16f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:39.548156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b28e12-bd4c-46d6-9219-32b6c549f16f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:39.612004 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-52b28e12-bd4c-46d6-9219-32b6c549f16f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:39.619590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-52b28e12-bd4c-46d6-9219-32b6c549f16f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084779 Jun 20 06:37:39.620153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 912/1752] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:39 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:40.640707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c41beeaf-5a47-4350-bd1a-666846e1a052 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:40.641319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c41beeaf-5a47-4350-bd1a-666846e1a052 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:40.648216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c41beeaf-5a47-4350-bd1a-666846e1a052 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:40.648664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c41beeaf-5a47-4350-bd1a-666846e1a052 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:40.649451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c41beeaf-5a47-4350-bd1a-666846e1a052 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:40.649885 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c41beeaf-5a47-4350-bd1a-666846e1a052 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:40.654618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:40.959008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c41beeaf-5a47-4350-bd1a-666846e1a052 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:40.967191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c41beeaf-5a47-4350-bd1a-666846e1a052 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.333583 Jun 20 06:37:40.967757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 841/1753] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:41.983431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3a8211cf-8d4f-4478-be7b-1aa5251891bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:41.984020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3a8211cf-8d4f-4478-be7b-1aa5251891bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:41.990432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a8211cf-8d4f-4478-be7b-1aa5251891bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:41.990871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a8211cf-8d4f-4478-be7b-1aa5251891bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:41.991617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a8211cf-8d4f-4478-be7b-1aa5251891bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:41.992045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a8211cf-8d4f-4478-be7b-1aa5251891bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:42.060381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3a8211cf-8d4f-4478-be7b-1aa5251891bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:42.067819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3a8211cf-8d4f-4478-be7b-1aa5251891bf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.088328 Jun 20 06:37:42.068374 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 913/1754] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:43.085243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-30571471-87a2-456e-9f6a-a17f6a410ad0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:43.085839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-30571471-87a2-456e-9f6a-a17f6a410ad0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:43.088443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:43.094463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30571471-87a2-456e-9f6a-a17f6a410ad0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:43.094908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30571471-87a2-456e-9f6a-a17f6a410ad0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:43.095666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30571471-87a2-456e-9f6a-a17f6a410ad0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:43.096105 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30571471-87a2-456e-9f6a-a17f6a410ad0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:43.158862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-30571471-87a2-456e-9f6a-a17f6a410ad0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:43.166425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-30571471-87a2-456e-9f6a-a17f6a410ad0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.085109 Jun 20 06:37:43.166997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 842/1755] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:44.183578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ac0bb1b7-d849-472d-a3d7-990c1674c906 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:44.184187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ac0bb1b7-d849-472d-a3d7-990c1674c906 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:44.186733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:44.192058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac0bb1b7-d849-472d-a3d7-990c1674c906 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:44.192500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac0bb1b7-d849-472d-a3d7-990c1674c906 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:44.193247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac0bb1b7-d849-472d-a3d7-990c1674c906 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:44.193704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac0bb1b7-d849-472d-a3d7-990c1674c906 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:44.196322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:37:44.255109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ac0bb1b7-d849-472d-a3d7-990c1674c906 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:44.262500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ac0bb1b7-d849-472d-a3d7-990c1674c906 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082735 Jun 20 06:37:44.263088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 914/1756] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:45.280291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-13aab021-e5d5-4b60-a6e0-e1f197eb97db tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:45.280905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-13aab021-e5d5-4b60-a6e0-e1f197eb97db tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:45.286999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13aab021-e5d5-4b60-a6e0-e1f197eb97db tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:45.287452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13aab021-e5d5-4b60-a6e0-e1f197eb97db tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:45.288214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13aab021-e5d5-4b60-a6e0-e1f197eb97db tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:45.288655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-13aab021-e5d5-4b60-a6e0-e1f197eb97db tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:45.351679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-13aab021-e5d5-4b60-a6e0-e1f197eb97db tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:45.359784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-13aab021-e5d5-4b60-a6e0-e1f197eb97db tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084158 Jun 20 06:37:45.360355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 843/1757] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:46.376752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0695b7dd-5c99-4871-8722-4be5b981d8f9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:46.377370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0695b7dd-5c99-4871-8722-4be5b981d8f9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:46.383841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0695b7dd-5c99-4871-8722-4be5b981d8f9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:46.384290 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0695b7dd-5c99-4871-8722-4be5b981d8f9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:46.385053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0695b7dd-5c99-4871-8722-4be5b981d8f9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:46.385518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0695b7dd-5c99-4871-8722-4be5b981d8f9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:46.445049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0695b7dd-5c99-4871-8722-4be5b981d8f9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:46.452694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0695b7dd-5c99-4871-8722-4be5b981d8f9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.079799 Jun 20 06:37:46.453240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 915/1758] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:47.472141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f388697a-af63-407b-80be-be892ca1a536 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:47.472750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f388697a-af63-407b-80be-be892ca1a536 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:47.479266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f388697a-af63-407b-80be-be892ca1a536 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:47.479704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f388697a-af63-407b-80be-be892ca1a536 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:47.480456 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f388697a-af63-407b-80be-be892ca1a536 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:47.480886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f388697a-af63-407b-80be-be892ca1a536 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:47.542559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f388697a-af63-407b-80be-be892ca1a536 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:47.550572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f388697a-af63-407b-80be-be892ca1a536 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082248 Jun 20 06:37:47.551070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 844/1759] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:48.567833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-31f22b96-bc00-46f5-b3bd-4d59576bce1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:48.568439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-31f22b96-bc00-46f5-b3bd-4d59576bce1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:48.575012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-31f22b96-bc00-46f5-b3bd-4d59576bce1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:48.575988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-31f22b96-bc00-46f5-b3bd-4d59576bce1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:48.576753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-31f22b96-bc00-46f5-b3bd-4d59576bce1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:48.577184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-31f22b96-bc00-46f5-b3bd-4d59576bce1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:48.638169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-31f22b96-bc00-46f5-b3bd-4d59576bce1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:48.645915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-31f22b96-bc00-46f5-b3bd-4d59576bce1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081978 Jun 20 06:37:48.646472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 916/1760] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:49.663998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1e443f86-7dfe-4beb-8de8-d92b9ee9510e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:49.664604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1e443f86-7dfe-4beb-8de8-d92b9ee9510e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:49.671751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e443f86-7dfe-4beb-8de8-d92b9ee9510e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:49.672211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e443f86-7dfe-4beb-8de8-d92b9ee9510e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:49.672981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e443f86-7dfe-4beb-8de8-d92b9ee9510e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:49.673445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e443f86-7dfe-4beb-8de8-d92b9ee9510e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:49.736325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1e443f86-7dfe-4beb-8de8-d92b9ee9510e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:49.743842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1e443f86-7dfe-4beb-8de8-d92b9ee9510e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083750 Jun 20 06:37:49.744414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 845/1761] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:49 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:50.086330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:37:50.086545 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:37:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:37:50.760337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-56f51115-979f-4ebf-89ac-a626a52202c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:50.760948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-56f51115-979f-4ebf-89ac-a626a52202c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:50.768013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56f51115-979f-4ebf-89ac-a626a52202c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:50.768462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56f51115-979f-4ebf-89ac-a626a52202c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:50.769217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56f51115-979f-4ebf-89ac-a626a52202c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:50.769671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56f51115-979f-4ebf-89ac-a626a52202c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:50.830985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-56f51115-979f-4ebf-89ac-a626a52202c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:50.838418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-56f51115-979f-4ebf-89ac-a626a52202c4 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081972 Jun 20 06:37:50.839017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 917/1762] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:51.856124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0b8eee3c-5a85-4247-8749-fe670a9dc368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:51.857354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0b8eee3c-5a85-4247-8749-fe670a9dc368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:51.863835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b8eee3c-5a85-4247-8749-fe670a9dc368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:51.864279 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b8eee3c-5a85-4247-8749-fe670a9dc368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:51.865035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b8eee3c-5a85-4247-8749-fe670a9dc368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:51.865497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b8eee3c-5a85-4247-8749-fe670a9dc368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:51.925569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0b8eee3c-5a85-4247-8749-fe670a9dc368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:51.933042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0b8eee3c-5a85-4247-8749-fe670a9dc368 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080752 Jun 20 06:37:51.933702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 846/1763] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:52.949871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9758b730-bdf4-412f-aa26-86dc3936ad53 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:52.951052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9758b730-bdf4-412f-aa26-86dc3936ad53 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:52.957405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9758b730-bdf4-412f-aa26-86dc3936ad53 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:52.957872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9758b730-bdf4-412f-aa26-86dc3936ad53 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:52.958634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9758b730-bdf4-412f-aa26-86dc3936ad53 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:52.959075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9758b730-bdf4-412f-aa26-86dc3936ad53 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:53.021707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9758b730-bdf4-412f-aa26-86dc3936ad53 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:53.029911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9758b730-bdf4-412f-aa26-86dc3936ad53 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083890 Jun 20 06:37:53.030487 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 918/1764] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:54.047526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-da5e06bb-e68d-434c-a7f9-c8968f64f6ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:54.048284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-da5e06bb-e68d-434c-a7f9-c8968f64f6ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:54.054657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da5e06bb-e68d-434c-a7f9-c8968f64f6ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:54.055107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da5e06bb-e68d-434c-a7f9-c8968f64f6ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:54.055871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da5e06bb-e68d-434c-a7f9-c8968f64f6ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:54.056605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da5e06bb-e68d-434c-a7f9-c8968f64f6ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:54.121290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-da5e06bb-e68d-434c-a7f9-c8968f64f6ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:54.129232 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-da5e06bb-e68d-434c-a7f9-c8968f64f6ea tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.086203 Jun 20 06:37:54.129832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 847/1765] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:55.146644 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4aaf0a18-eb4e-42c1-addd-535d3ff40a2b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:55.147255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4aaf0a18-eb4e-42c1-addd-535d3ff40a2b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:55.154488 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4aaf0a18-eb4e-42c1-addd-535d3ff40a2b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:55.154937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4aaf0a18-eb4e-42c1-addd-535d3ff40a2b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:55.155694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4aaf0a18-eb4e-42c1-addd-535d3ff40a2b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:55.156125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4aaf0a18-eb4e-42c1-addd-535d3ff40a2b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:55.215043 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4aaf0a18-eb4e-42c1-addd-535d3ff40a2b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:55.223075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4aaf0a18-eb4e-42c1-addd-535d3ff40a2b tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080344 Jun 20 06:37:55.223639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 919/1766] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:56.239898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a884a39f-02cb-483d-914d-97950e78779d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:56.240491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a884a39f-02cb-483d-914d-97950e78779d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:56.246919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a884a39f-02cb-483d-914d-97950e78779d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:56.247370 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a884a39f-02cb-483d-914d-97950e78779d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:56.248183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a884a39f-02cb-483d-914d-97950e78779d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:56.248623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a884a39f-02cb-483d-914d-97950e78779d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:56.309570 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a884a39f-02cb-483d-914d-97950e78779d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:56.317251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a884a39f-02cb-483d-914d-97950e78779d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081135 Jun 20 06:37:56.317856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 848/1767] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:57.379818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-876a2791-5fa1-4cb1-b314-d2fd1ab5a60d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:57.380429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-876a2791-5fa1-4cb1-b314-d2fd1ab5a60d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:57.386298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-876a2791-5fa1-4cb1-b314-d2fd1ab5a60d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:57.386737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-876a2791-5fa1-4cb1-b314-d2fd1ab5a60d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:57.387488 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-876a2791-5fa1-4cb1-b314-d2fd1ab5a60d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:57.387919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-876a2791-5fa1-4cb1-b314-d2fd1ab5a60d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:57.450431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-876a2791-5fa1-4cb1-b314-d2fd1ab5a60d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:57.457884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-876a2791-5fa1-4cb1-b314-d2fd1ab5a60d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.128145 Jun 20 06:37:57.458434 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 920/1768] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:57.542848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:37:57.543085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:37:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:37:58.475052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-49c9b8fb-4d04-4be7-9c6d-b7a2f60b2f94 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:58.475667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-49c9b8fb-4d04-4be7-9c6d-b7a2f60b2f94 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:58.482235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49c9b8fb-4d04-4be7-9c6d-b7a2f60b2f94 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:58.482797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49c9b8fb-4d04-4be7-9c6d-b7a2f60b2f94 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:58.483559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49c9b8fb-4d04-4be7-9c6d-b7a2f60b2f94 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:58.484001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-49c9b8fb-4d04-4be7-9c6d-b7a2f60b2f94 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:58.548854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-49c9b8fb-4d04-4be7-9c6d-b7a2f60b2f94 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:58.556314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-49c9b8fb-4d04-4be7-9c6d-b7a2f60b2f94 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.085159 Jun 20 06:37:58.556870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 849/1769] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:59.573522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-962b76ab-e3bc-48a6-92b1-c66ff3d94ac0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:37:59.574127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-962b76ab-e3bc-48a6-92b1-c66ff3d94ac0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:37:59.581182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-962b76ab-e3bc-48a6-92b1-c66ff3d94ac0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:59.581666 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-962b76ab-e3bc-48a6-92b1-c66ff3d94ac0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:59.582443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-962b76ab-e3bc-48a6-92b1-c66ff3d94ac0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:37:59.582872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-962b76ab-e3bc-48a6-92b1-c66ff3d94ac0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:37:59.644127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-962b76ab-e3bc-48a6-92b1-c66ff3d94ac0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:37:59.651567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-962b76ab-e3bc-48a6-92b1-c66ff3d94ac0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081955 Jun 20 06:37:59.652114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 921/1770] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:37:59 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:37:59.779052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:37:59.780152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:37:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:38:00.668230 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f8e63320-e14c-492d-bf93-5c89b1aff9e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:00.668840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f8e63320-e14c-492d-bf93-5c89b1aff9e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:00.676426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8e63320-e14c-492d-bf93-5c89b1aff9e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:00.676880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8e63320-e14c-492d-bf93-5c89b1aff9e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:00.677664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8e63320-e14c-492d-bf93-5c89b1aff9e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:00.678102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8e63320-e14c-492d-bf93-5c89b1aff9e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:00.739007 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f8e63320-e14c-492d-bf93-5c89b1aff9e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:00.746516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f8e63320-e14c-492d-bf93-5c89b1aff9e7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082151 Jun 20 06:38:00.747079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 850/1771] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:00 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:01.762339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c62e8044-b106-480a-9323-42fb4ee6f06a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:01.762949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c62e8044-b106-480a-9323-42fb4ee6f06a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:01.769879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c62e8044-b106-480a-9323-42fb4ee6f06a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:01.770329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c62e8044-b106-480a-9323-42fb4ee6f06a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:01.771120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c62e8044-b106-480a-9323-42fb4ee6f06a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:01.771553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c62e8044-b106-480a-9323-42fb4ee6f06a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:01.831937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c62e8044-b106-480a-9323-42fb4ee6f06a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:01.839412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c62e8044-b106-480a-9323-42fb4ee6f06a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080933 Jun 20 06:38:01.839967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 922/1772] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:01 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:02.856294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-237e0559-efa9-4763-9adc-d1938a9c156d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:02.856901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-237e0559-efa9-4763-9adc-d1938a9c156d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:02.863938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-237e0559-efa9-4763-9adc-d1938a9c156d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:02.864385 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-237e0559-efa9-4763-9adc-d1938a9c156d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:02.865131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-237e0559-efa9-4763-9adc-d1938a9c156d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:02.865594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-237e0559-efa9-4763-9adc-d1938a9c156d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:02.928389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-237e0559-efa9-4763-9adc-d1938a9c156d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:02.935814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-237e0559-efa9-4763-9adc-d1938a9c156d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083314 Jun 20 06:38:02.936523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 851/1773] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:02 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:03.952637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c1f837f4-0395-40ac-a704-10fc954a7d7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:03.953280 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c1f837f4-0395-40ac-a704-10fc954a7d7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:03.959697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1f837f4-0395-40ac-a704-10fc954a7d7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:03.960189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1f837f4-0395-40ac-a704-10fc954a7d7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:03.961015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1f837f4-0395-40ac-a704-10fc954a7d7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:03.961474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1f837f4-0395-40ac-a704-10fc954a7d7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:04.021279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c1f837f4-0395-40ac-a704-10fc954a7d7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:04.029024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c1f837f4-0395-40ac-a704-10fc954a7d7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080294 Jun 20 06:38:04.029603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 923/1774] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:03 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:05.045169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ad0f82b4-2a3a-4836-9a7b-01e79d3380fb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:05.045746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ad0f82b4-2a3a-4836-9a7b-01e79d3380fb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:05.052267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad0f82b4-2a3a-4836-9a7b-01e79d3380fb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:05.052712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad0f82b4-2a3a-4836-9a7b-01e79d3380fb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:05.053565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad0f82b4-2a3a-4836-9a7b-01e79d3380fb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:05.053996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad0f82b4-2a3a-4836-9a7b-01e79d3380fb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:05.114500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ad0f82b4-2a3a-4836-9a7b-01e79d3380fb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:05.121874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ad0f82b4-2a3a-4836-9a7b-01e79d3380fb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080663 Jun 20 06:38:05.122423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 852/1775] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:05 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:06.139660 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a00cd630-c1d7-4a36-9d97-c4dd31afe8b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:06.140291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a00cd630-c1d7-4a36-9d97-c4dd31afe8b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:06.147872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a00cd630-c1d7-4a36-9d97-c4dd31afe8b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:06.148320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a00cd630-c1d7-4a36-9d97-c4dd31afe8b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:06.149076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a00cd630-c1d7-4a36-9d97-c4dd31afe8b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:06.149544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a00cd630-c1d7-4a36-9d97-c4dd31afe8b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:06.209742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a00cd630-c1d7-4a36-9d97-c4dd31afe8b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:06.217089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a00cd630-c1d7-4a36-9d97-c4dd31afe8b1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081594 Jun 20 06:38:06.217670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 924/1776] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:06 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:07.236768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6449572d-cf2c-4549-89ce-ed8dadc434dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:07.237403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6449572d-cf2c-4549-89ce-ed8dadc434dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:07.243844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6449572d-cf2c-4549-89ce-ed8dadc434dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:07.244290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6449572d-cf2c-4549-89ce-ed8dadc434dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:07.245051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6449572d-cf2c-4549-89ce-ed8dadc434dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:07.245518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6449572d-cf2c-4549-89ce-ed8dadc434dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:07.314067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6449572d-cf2c-4549-89ce-ed8dadc434dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:07.321722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6449572d-cf2c-4549-89ce-ed8dadc434dd tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.089930 Jun 20 06:38:07.322291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 853/1777] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:07 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:08.338480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e1fb709d-c490-4507-8449-b0493e08f0c6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:08.339092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e1fb709d-c490-4507-8449-b0493e08f0c6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:08.346735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1fb709d-c490-4507-8449-b0493e08f0c6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:08.347184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1fb709d-c490-4507-8449-b0493e08f0c6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:08.347944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1fb709d-c490-4507-8449-b0493e08f0c6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:08.348379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1fb709d-c490-4507-8449-b0493e08f0c6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:08.410941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e1fb709d-c490-4507-8449-b0493e08f0c6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:08.418308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e1fb709d-c490-4507-8449-b0493e08f0c6 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083719 Jun 20 06:38:08.418865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 925/1778] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:08 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:09.435860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8268c1b1-aa71-4e24-be59-f6424c6d3d3f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:09.436479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8268c1b1-aa71-4e24-be59-f6424c6d3d3f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:09.443746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8268c1b1-aa71-4e24-be59-f6424c6d3d3f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:09.444204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8268c1b1-aa71-4e24-be59-f6424c6d3d3f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:09.444973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8268c1b1-aa71-4e24-be59-f6424c6d3d3f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:09.445441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8268c1b1-aa71-4e24-be59-f6424c6d3d3f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:09.505567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8268c1b1-aa71-4e24-be59-f6424c6d3d3f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:09.513055 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8268c1b1-aa71-4e24-be59-f6424c6d3d3f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081096 Jun 20 06:38:09.513660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 854/1779] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:09 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:10.530581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-998f0f76-4468-40fa-99f8-ade2d5e391a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:10.531320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-998f0f76-4468-40fa-99f8-ade2d5e391a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:10.538042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-998f0f76-4468-40fa-99f8-ade2d5e391a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:10.538493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-998f0f76-4468-40fa-99f8-ade2d5e391a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:10.539254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-998f0f76-4468-40fa-99f8-ade2d5e391a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:10.539691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-998f0f76-4468-40fa-99f8-ade2d5e391a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:10.600687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-998f0f76-4468-40fa-99f8-ade2d5e391a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:10.608444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-998f0f76-4468-40fa-99f8-ade2d5e391a0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082011 Jun 20 06:38:10.609771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 926/1780] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:10 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:10.877658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:10.878185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:10.884574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:10.885056 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:10.885845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:10.886398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:10.890410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:10.900650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] HTTP exception thrown: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Request method failure captured: Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 HTTP/1.1 Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBEqJDeZtlG-76F9Hi4_noX4_tneao6vpYIiYQyaYvdpuOkX8aoM1hpdwBXJme_lnOgm3F_vrfWtSCxavSew2AgbdU00NoRsq1ru6feT1r9ReY4KmDcnf7fvgIEVVBT7oFxAdaOflWS25iHWid_ZHHLne8-r_H3tLh3LxO6zrjUIz_g Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:38:10.902245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}] Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 5fc0e8fe250349d699ea43aeee98170e Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.904126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': 'cdad6d85-f1f9-48e6-91e0-88fca110dcb7'} Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:38:10.905204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.906781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.908698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Returning 404 to user: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:38:10.908698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-63d42eda-1e91-4449-b5e0-0509f7832dc7 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 404 len: 111 microversion: 2.20 time: 0.030483 Jun 20 06:38:10.908698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 855/1781] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Jun 20 06:38:10 2022] DELETE /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:38:10.921157 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:10.921796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: cdad6d85-f1f9-48e6-91e0-88fca110dcb7] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:10.929191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:10.929672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:10.930430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:10.930859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:10.945268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] HTTP exception thrown: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Request method failure captured: Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 HTTP/1.1 Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBEqJDeZtlG-76F9Hi4_noX4_tneao6vpYIiYQyaYvdpuOkX8aoM1hpdwBXJme_lnOgm3F_vrfWtSCxavSew2AgbdU00NoRsq1ru6feT1r9ReY4KmDcnf7fvgIEVVBT7oFxAdaOflWS25iHWid_ZHHLne8-r_H3tLh3LxO6zrjUIz_g Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:38:10.947193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}] Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 5fc0e8fe250349d699ea43aeee98170e Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.949014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'cdad6d85-f1f9-48e6-91e0-88fca110dcb7'} Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:38:10.950029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. Jun 20 06:38:10.951720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:38:10.953173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Returning 404 to user: Instance cdad6d85-f1f9-48e6-91e0-88fca110dcb7 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:38:10.953173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b3a56822-9a02-4a7d-9e80-edb7bb91994c tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7" status: 404 len: 111 microversion: 2.20 time: 0.030976 Jun 20 06:38:10.953173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 927/1782] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:38:10 2022] GET /compute/v2.1/servers/cdad6d85-f1f9-48e6-91e0-88fca110dcb7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:38:11.625632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8748a812-d6c6-4b60-9107-6aede1fedec1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:11.626871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8748a812-d6c6-4b60-9107-6aede1fedec1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:11.632812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8748a812-d6c6-4b60-9107-6aede1fedec1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:11.633263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8748a812-d6c6-4b60-9107-6aede1fedec1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:11.634062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8748a812-d6c6-4b60-9107-6aede1fedec1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:11.634499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8748a812-d6c6-4b60-9107-6aede1fedec1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:11.699709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8748a812-d6c6-4b60-9107-6aede1fedec1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:11.707251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8748a812-d6c6-4b60-9107-6aede1fedec1 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.085552 Jun 20 06:38:11.707817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 856/1783] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:11 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:12.724097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-85ba2766-ed23-4bb5-9dec-370296e4fc1a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:12.724711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-85ba2766-ed23-4bb5-9dec-370296e4fc1a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:12.731236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85ba2766-ed23-4bb5-9dec-370296e4fc1a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:12.731684 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85ba2766-ed23-4bb5-9dec-370296e4fc1a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:12.732441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85ba2766-ed23-4bb5-9dec-370296e4fc1a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:12.732903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85ba2766-ed23-4bb5-9dec-370296e4fc1a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:12.798511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-85ba2766-ed23-4bb5-9dec-370296e4fc1a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:12.807427 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-85ba2766-ed23-4bb5-9dec-370296e4fc1a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.087365 Jun 20 06:38:12.807995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 928/1784] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:12 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:13.824213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9a159991-d2bc-477c-b5cd-9b0e6be25775 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:13.824821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9a159991-d2bc-477c-b5cd-9b0e6be25775 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:13.827191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=30 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:13.832680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a159991-d2bc-477c-b5cd-9b0e6be25775 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:13.833125 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a159991-d2bc-477c-b5cd-9b0e6be25775 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:13.833910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a159991-d2bc-477c-b5cd-9b0e6be25775 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:13.834337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a159991-d2bc-477c-b5cd-9b0e6be25775 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:13.894385 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a159991-d2bc-477c-b5cd-9b0e6be25775 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:13.902099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9a159991-d2bc-477c-b5cd-9b0e6be25775 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081971 Jun 20 06:38:13.902684 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 857/1785] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:13 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:14.919362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-23d59371-1ae3-43af-91c2-873e84074284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:14.919978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-23d59371-1ae3-43af-91c2-873e84074284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:14.922271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=30 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:14.927314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23d59371-1ae3-43af-91c2-873e84074284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:14.927762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23d59371-1ae3-43af-91c2-873e84074284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:14.928527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23d59371-1ae3-43af-91c2-873e84074284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:14.928963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23d59371-1ae3-43af-91c2-873e84074284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:14.933198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=86 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:14.989873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-23d59371-1ae3-43af-91c2-873e84074284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:14.997225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-23d59371-1ae3-43af-91c2-873e84074284 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081830 Jun 20 06:38:14.997804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 929/1786] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:14 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:16.014899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e93a5395-ae29-4e6b-9263-b0330b750a0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:16.015503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e93a5395-ae29-4e6b-9263-b0330b750a0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:16.022354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e93a5395-ae29-4e6b-9263-b0330b750a0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:16.022800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e93a5395-ae29-4e6b-9263-b0330b750a0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:16.023558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e93a5395-ae29-4e6b-9263-b0330b750a0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:16.023997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e93a5395-ae29-4e6b-9263-b0330b750a0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:16.086922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e93a5395-ae29-4e6b-9263-b0330b750a0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:16.094347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e93a5395-ae29-4e6b-9263-b0330b750a0c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083581 Jun 20 06:38:16.094906 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 858/1787] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:16 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:17.112716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f2e6598-46a0-4f7f-be05-b0ea16efa3ff tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:17.113335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f2e6598-46a0-4f7f-be05-b0ea16efa3ff tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:17.120409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f2e6598-46a0-4f7f-be05-b0ea16efa3ff tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:17.120862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f2e6598-46a0-4f7f-be05-b0ea16efa3ff tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:17.121648 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f2e6598-46a0-4f7f-be05-b0ea16efa3ff tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:17.122085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f2e6598-46a0-4f7f-be05-b0ea16efa3ff tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:17.189671 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7f2e6598-46a0-4f7f-be05-b0ea16efa3ff tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:17.197009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f2e6598-46a0-4f7f-be05-b0ea16efa3ff tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.088842 Jun 20 06:38:17.197595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 930/1788] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:17 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:18.213825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f960f224-a131-44f3-a079-ebda44d42854 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:18.214424 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f960f224-a131-44f3-a079-ebda44d42854 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:18.220826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f960f224-a131-44f3-a079-ebda44d42854 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:18.221266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f960f224-a131-44f3-a079-ebda44d42854 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:18.222090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f960f224-a131-44f3-a079-ebda44d42854 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:18.222520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f960f224-a131-44f3-a079-ebda44d42854 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:18.282743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f960f224-a131-44f3-a079-ebda44d42854 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:18.290326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f960f224-a131-44f3-a079-ebda44d42854 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080356 Jun 20 06:38:18.290877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 859/1789] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:18 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:19.307145 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-92b940b3-ee08-4d82-97be-f207d774372c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:19.307750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-92b940b3-ee08-4d82-97be-f207d774372c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:19.314383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92b940b3-ee08-4d82-97be-f207d774372c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:19.314826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92b940b3-ee08-4d82-97be-f207d774372c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:19.315620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92b940b3-ee08-4d82-97be-f207d774372c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:19.316080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-92b940b3-ee08-4d82-97be-f207d774372c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:19.380506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-92b940b3-ee08-4d82-97be-f207d774372c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:19.388011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-92b940b3-ee08-4d82-97be-f207d774372c tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084715 Jun 20 06:38:19.388566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 931/1790] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:19 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:20.405137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-71dc29da-875a-48fa-83df-54c04bd19f7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:20.405772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-71dc29da-875a-48fa-83df-54c04bd19f7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:20.412843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71dc29da-875a-48fa-83df-54c04bd19f7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:20.413281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71dc29da-875a-48fa-83df-54c04bd19f7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:20.414136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71dc29da-875a-48fa-83df-54c04bd19f7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:20.414565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71dc29da-875a-48fa-83df-54c04bd19f7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:20.477489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-71dc29da-875a-48fa-83df-54c04bd19f7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:20.484968 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-71dc29da-875a-48fa-83df-54c04bd19f7a tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083624 Jun 20 06:38:20.485568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 860/1791] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:20 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:20.523307 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:38:20.523477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:38:21.502075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-510315fd-261f-463c-93c0-3d847be29ff3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:21.502693 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-510315fd-261f-463c-93c0-3d847be29ff3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:21.509236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-510315fd-261f-463c-93c0-3d847be29ff3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:21.509722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-510315fd-261f-463c-93c0-3d847be29ff3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:21.510504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-510315fd-261f-463c-93c0-3d847be29ff3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:21.510943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-510315fd-261f-463c-93c0-3d847be29ff3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:21.571638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-510315fd-261f-463c-93c0-3d847be29ff3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:21.579003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-510315fd-261f-463c-93c0-3d847be29ff3 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080868 Jun 20 06:38:21.579565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 932/1792] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:21 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:22.595202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cb5746f6-9e1f-4d5b-96cf-ae1bc8cdc3a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:22.595760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cb5746f6-9e1f-4d5b-96cf-ae1bc8cdc3a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:22.602452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5746f6-9e1f-4d5b-96cf-ae1bc8cdc3a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:22.602891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5746f6-9e1f-4d5b-96cf-ae1bc8cdc3a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:22.603646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5746f6-9e1f-4d5b-96cf-ae1bc8cdc3a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:22.604078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb5746f6-9e1f-4d5b-96cf-ae1bc8cdc3a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:22.665309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cb5746f6-9e1f-4d5b-96cf-ae1bc8cdc3a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:22.672756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cb5746f6-9e1f-4d5b-96cf-ae1bc8cdc3a7 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081483 Jun 20 06:38:22.673325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 861/1793] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:22 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:23.690163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ec425922-8934-4df9-b9a2-c8ef1c265a80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:23.690776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ec425922-8934-4df9-b9a2-c8ef1c265a80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:23.698093 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec425922-8934-4df9-b9a2-c8ef1c265a80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:23.698537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec425922-8934-4df9-b9a2-c8ef1c265a80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:23.699297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec425922-8934-4df9-b9a2-c8ef1c265a80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:23.699730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec425922-8934-4df9-b9a2-c8ef1c265a80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:23.762519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ec425922-8934-4df9-b9a2-c8ef1c265a80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:23.770485 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ec425922-8934-4df9-b9a2-c8ef1c265a80 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083956 Jun 20 06:38:23.771071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 933/1794] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:23 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:24.787095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6d610086-cf88-43ec-945c-23e37fcf9bcb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:24.787756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6d610086-cf88-43ec-945c-23e37fcf9bcb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:24.794250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d610086-cf88-43ec-945c-23e37fcf9bcb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:24.794694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d610086-cf88-43ec-945c-23e37fcf9bcb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:24.795448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d610086-cf88-43ec-945c-23e37fcf9bcb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:24.795878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d610086-cf88-43ec-945c-23e37fcf9bcb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:24.861992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6d610086-cf88-43ec-945c-23e37fcf9bcb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:24.869483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6d610086-cf88-43ec-945c-23e37fcf9bcb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.086831 Jun 20 06:38:24.870043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 862/1795] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:24 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:25.888344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e0722549-e398-48c7-a885-4328fac63529 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:25.889241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e0722549-e398-48c7-a885-4328fac63529 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:25.896837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0722549-e398-48c7-a885-4328fac63529 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:25.897362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0722549-e398-48c7-a885-4328fac63529 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:25.898148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0722549-e398-48c7-a885-4328fac63529 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:25.898611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0722549-e398-48c7-a885-4328fac63529 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:25.960483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e0722549-e398-48c7-a885-4328fac63529 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:25.967820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e0722549-e398-48c7-a885-4328fac63529 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083598 Jun 20 06:38:25.968376 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 934/1796] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:25 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:26.984363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e4231e93-4cf3-4d17-b568-e6afcd67949e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:26.984971 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e4231e93-4cf3-4d17-b568-e6afcd67949e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:26.992177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4231e93-4cf3-4d17-b568-e6afcd67949e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:26.992621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4231e93-4cf3-4d17-b568-e6afcd67949e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:26.993373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4231e93-4cf3-4d17-b568-e6afcd67949e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:26.993828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4231e93-4cf3-4d17-b568-e6afcd67949e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:27.054957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4231e93-4cf3-4d17-b568-e6afcd67949e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:27.062407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e4231e93-4cf3-4d17-b568-e6afcd67949e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081969 Jun 20 06:38:27.062958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 863/1797] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:26 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:28.080332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-802342b0-6108-4950-b954-1e2084973a58 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:28.080877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-802342b0-6108-4950-b954-1e2084973a58 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:28.089547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-802342b0-6108-4950-b954-1e2084973a58 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:28.090003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-802342b0-6108-4950-b954-1e2084973a58 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:28.090776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-802342b0-6108-4950-b954-1e2084973a58 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:28.091217 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-802342b0-6108-4950-b954-1e2084973a58 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:28.158461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-802342b0-6108-4950-b954-1e2084973a58 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:28.166073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-802342b0-6108-4950-b954-1e2084973a58 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.089789 Jun 20 06:38:28.166631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 935/1798] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:28 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:29.183325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1dc2fa1e-c17c-4eb2-b315-abd7f1866289 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:29.183959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1dc2fa1e-c17c-4eb2-b315-abd7f1866289 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:29.190172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1dc2fa1e-c17c-4eb2-b315-abd7f1866289 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:29.190619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1dc2fa1e-c17c-4eb2-b315-abd7f1866289 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:29.191373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1dc2fa1e-c17c-4eb2-b315-abd7f1866289 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:29.191805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1dc2fa1e-c17c-4eb2-b315-abd7f1866289 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:29.254932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1dc2fa1e-c17c-4eb2-b315-abd7f1866289 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:29.262556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1dc2fa1e-c17c-4eb2-b315-abd7f1866289 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084172 Jun 20 06:38:29.263171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 864/1799] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:29 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:38:30.279893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bc396ed0-2ba7-4340-81eb-e8b78f823c85 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:30.280488 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bc396ed0-2ba7-4340-81eb-e8b78f823c85 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:30.287017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc396ed0-2ba7-4340-81eb-e8b78f823c85 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:30.287472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc396ed0-2ba7-4340-81eb-e8b78f823c85 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:30.288233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc396ed0-2ba7-4340-81eb-e8b78f823c85 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:30.288668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc396ed0-2ba7-4340-81eb-e8b78f823c85 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:30.350963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bc396ed0-2ba7-4340-81eb-e8b78f823c85 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:30.358576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bc396ed0-2ba7-4340-81eb-e8b78f823c85 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082536 Jun 20 06:38:30.359137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 936/1800] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:30 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:31.375990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-837dc5dc-fa2d-46ce-87ad-3b202140b004 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:31.376610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-837dc5dc-fa2d-46ce-87ad-3b202140b004 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:31.384108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-837dc5dc-fa2d-46ce-87ad-3b202140b004 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:31.384557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-837dc5dc-fa2d-46ce-87ad-3b202140b004 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:31.385319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-837dc5dc-fa2d-46ce-87ad-3b202140b004 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:31.385800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-837dc5dc-fa2d-46ce-87ad-3b202140b004 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:31.447785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-837dc5dc-fa2d-46ce-87ad-3b202140b004 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:31.455327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-837dc5dc-fa2d-46ce-87ad-3b202140b004 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083189 Jun 20 06:38:31.455890 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 865/1801] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:31 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:32.472923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b2fc4774-6646-46f5-a1e9-48fb20a76454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:32.473568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b2fc4774-6646-46f5-a1e9-48fb20a76454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:32.480737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b2fc4774-6646-46f5-a1e9-48fb20a76454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:32.481184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b2fc4774-6646-46f5-a1e9-48fb20a76454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:32.481970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b2fc4774-6646-46f5-a1e9-48fb20a76454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:32.482401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b2fc4774-6646-46f5-a1e9-48fb20a76454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:32.546010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b2fc4774-6646-46f5-a1e9-48fb20a76454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:32.553843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b2fc4774-6646-46f5-a1e9-48fb20a76454 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084262 Jun 20 06:38:32.554384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 937/1802] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:32 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:33.570258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ca2f72f3-c67a-4a63-b8bc-6600806225e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:33.570864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ca2f72f3-c67a-4a63-b8bc-6600806225e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:33.577322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca2f72f3-c67a-4a63-b8bc-6600806225e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:33.577793 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca2f72f3-c67a-4a63-b8bc-6600806225e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:33.578543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca2f72f3-c67a-4a63-b8bc-6600806225e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:33.578976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca2f72f3-c67a-4a63-b8bc-6600806225e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:33.639402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ca2f72f3-c67a-4a63-b8bc-6600806225e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:33.646946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ca2f72f3-c67a-4a63-b8bc-6600806225e0 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080706 Jun 20 06:38:33.647519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 866/1803] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:33 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:34.663529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38847c0c-a8a8-4a1b-a902-a109e89fc478 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:34.664320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-38847c0c-a8a8-4a1b-a902-a109e89fc478 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:34.670560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38847c0c-a8a8-4a1b-a902-a109e89fc478 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:34.671026 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38847c0c-a8a8-4a1b-a902-a109e89fc478 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:34.671779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38847c0c-a8a8-4a1b-a902-a109e89fc478 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:34.672206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38847c0c-a8a8-4a1b-a902-a109e89fc478 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:34.732723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-38847c0c-a8a8-4a1b-a902-a109e89fc478 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:34.740174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-38847c0c-a8a8-4a1b-a902-a109e89fc478 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.080482 Jun 20 06:38:34.740732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 938/1804] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:34 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:35.757712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bae4f287-e4be-462c-bb54-d40bbd535faa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:35.758299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bae4f287-e4be-462c-bb54-d40bbd535faa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:35.765632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bae4f287-e4be-462c-bb54-d40bbd535faa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:35.766075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bae4f287-e4be-462c-bb54-d40bbd535faa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:35.766824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bae4f287-e4be-462c-bb54-d40bbd535faa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:35.767262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bae4f287-e4be-462c-bb54-d40bbd535faa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:35.828000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bae4f287-e4be-462c-bb54-d40bbd535faa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:35.835439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bae4f287-e4be-462c-bb54-d40bbd535faa tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081606 Jun 20 06:38:35.836001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 867/1805] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:35 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:36.852691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-09826739-c4a6-4e58-9bfd-2d0a0365cacf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:36.853368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-09826739-c4a6-4e58-9bfd-2d0a0365cacf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:36.859799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09826739-c4a6-4e58-9bfd-2d0a0365cacf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:36.860188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09826739-c4a6-4e58-9bfd-2d0a0365cacf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:36.860939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09826739-c4a6-4e58-9bfd-2d0a0365cacf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:36.861369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09826739-c4a6-4e58-9bfd-2d0a0365cacf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:36.928811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-09826739-c4a6-4e58-9bfd-2d0a0365cacf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:36.936354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-09826739-c4a6-4e58-9bfd-2d0a0365cacf tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.088215 Jun 20 06:38:36.936911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 939/1806] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:36 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:37.953190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-649eb9cb-cc0a-4ae0-aa83-b2349994bb81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:37.953869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-649eb9cb-cc0a-4ae0-aa83-b2349994bb81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:37.960286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-649eb9cb-cc0a-4ae0-aa83-b2349994bb81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:37.960737 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-649eb9cb-cc0a-4ae0-aa83-b2349994bb81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:37.962727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-649eb9cb-cc0a-4ae0-aa83-b2349994bb81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:37.963162 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-649eb9cb-cc0a-4ae0-aa83-b2349994bb81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:38.024824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-649eb9cb-cc0a-4ae0-aa83-b2349994bb81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:38.032319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-649eb9cb-cc0a-4ae0-aa83-b2349994bb81 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083000 Jun 20 06:38:38.032880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 868/1807] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:37 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:39.049462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7e458dd0-d604-479e-ba68-46e154ea1760 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:39.050077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7e458dd0-d604-479e-ba68-46e154ea1760 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:39.057101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e458dd0-d604-479e-ba68-46e154ea1760 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:39.057591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e458dd0-d604-479e-ba68-46e154ea1760 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:39.058360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e458dd0-d604-479e-ba68-46e154ea1760 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:39.058795 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e458dd0-d604-479e-ba68-46e154ea1760 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:39.124876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7e458dd0-d604-479e-ba68-46e154ea1760 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:39.133116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7e458dd0-d604-479e-ba68-46e154ea1760 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.087603 Jun 20 06:38:39.133988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 940/1808] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:39 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:40.151243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5f613aca-e2f7-42c7-992a-03a9c19fe132 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:40.151856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5f613aca-e2f7-42c7-992a-03a9c19fe132 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:40.158397 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f613aca-e2f7-42c7-992a-03a9c19fe132 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:40.158774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f613aca-e2f7-42c7-992a-03a9c19fe132 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:40.159531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f613aca-e2f7-42c7-992a-03a9c19fe132 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:40.159965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f613aca-e2f7-42c7-992a-03a9c19fe132 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:40.224488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5f613aca-e2f7-42c7-992a-03a9c19fe132 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:40.232658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5f613aca-e2f7-42c7-992a-03a9c19fe132 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.085881 Jun 20 06:38:40.233221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 869/1809] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:40 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:41.249425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-855df153-8892-4ce4-95e1-1fd5db1aa4b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:41.250056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-855df153-8892-4ce4-95e1-1fd5db1aa4b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:41.256402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-855df153-8892-4ce4-95e1-1fd5db1aa4b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:41.256843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-855df153-8892-4ce4-95e1-1fd5db1aa4b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:41.257629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-855df153-8892-4ce4-95e1-1fd5db1aa4b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:41.258991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-855df153-8892-4ce4-95e1-1fd5db1aa4b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:41.324051 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-855df153-8892-4ce4-95e1-1fd5db1aa4b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:41.331532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-855df153-8892-4ce4-95e1-1fd5db1aa4b9 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.085953 Jun 20 06:38:41.332084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 941/1810] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:41 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:38:42.348012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-073a780b-8509-4323-8b4b-2b65a1e79640 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:42.348644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-073a780b-8509-4323-8b4b-2b65a1e79640 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:42.356082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-073a780b-8509-4323-8b4b-2b65a1e79640 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:42.356523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-073a780b-8509-4323-8b4b-2b65a1e79640 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:42.357268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-073a780b-8509-4323-8b4b-2b65a1e79640 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:42.357722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-073a780b-8509-4323-8b4b-2b65a1e79640 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:42.362061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=86 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:42.419876 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-073a780b-8509-4323-8b4b-2b65a1e79640 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:42.427238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-073a780b-8509-4323-8b4b-2b65a1e79640 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083133 Jun 20 06:38:42.427801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 870/1811] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:42 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:43.446029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b10ad50c-3b3a-4199-a941-f8d7e2e13b89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:43.446866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b10ad50c-3b3a-4199-a941-f8d7e2e13b89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:43.455829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b10ad50c-3b3a-4199-a941-f8d7e2e13b89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:43.456276 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b10ad50c-3b3a-4199-a941-f8d7e2e13b89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:43.457048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b10ad50c-3b3a-4199-a941-f8d7e2e13b89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:43.457514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b10ad50c-3b3a-4199-a941-f8d7e2e13b89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:43.519696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b10ad50c-3b3a-4199-a941-f8d7e2e13b89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:43.527785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b10ad50c-3b3a-4199-a941-f8d7e2e13b89 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.086525 Jun 20 06:38:43.528339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 942/1812] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:43 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:44.546171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-27345ff7-68a5-48b0-acdc-3ab829dcb2b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:44.546918 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-27345ff7-68a5-48b0-acdc-3ab829dcb2b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:44.548846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:44.554391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27345ff7-68a5-48b0-acdc-3ab829dcb2b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:44.554834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27345ff7-68a5-48b0-acdc-3ab829dcb2b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:44.555775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27345ff7-68a5-48b0-acdc-3ab829dcb2b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:44.556210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27345ff7-68a5-48b0-acdc-3ab829dcb2b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:44.615769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-27345ff7-68a5-48b0-acdc-3ab829dcb2b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:44.623620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-27345ff7-68a5-48b0-acdc-3ab829dcb2b2 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082331 Jun 20 06:38:44.624175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 871/1813] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:44 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:45.640859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9cae24bf-b8a3-4e38-b29e-63f98a68771d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:45.641498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9cae24bf-b8a3-4e38-b29e-63f98a68771d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:45.643784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:45.648966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9cae24bf-b8a3-4e38-b29e-63f98a68771d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:45.649440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9cae24bf-b8a3-4e38-b29e-63f98a68771d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:45.650215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9cae24bf-b8a3-4e38-b29e-63f98a68771d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:45.650658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9cae24bf-b8a3-4e38-b29e-63f98a68771d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:45.653344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:38:45.714324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9cae24bf-b8a3-4e38-b29e-63f98a68771d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:45.721673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9cae24bf-b8a3-4e38-b29e-63f98a68771d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.084878 Jun 20 06:38:45.722228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 943/1814] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:45 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:46.739043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d3e8765f-823b-405a-aef7-a478cf025b05 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:46.739685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d3e8765f-823b-405a-aef7-a478cf025b05 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:46.746715 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d3e8765f-823b-405a-aef7-a478cf025b05 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:46.747199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d3e8765f-823b-405a-aef7-a478cf025b05 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:46.747988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d3e8765f-823b-405a-aef7-a478cf025b05 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:46.748434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d3e8765f-823b-405a-aef7-a478cf025b05 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:46.810672 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d3e8765f-823b-405a-aef7-a478cf025b05 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:46.818171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d3e8765f-823b-405a-aef7-a478cf025b05 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083027 Jun 20 06:38:46.818733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 872/1815] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:46 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:38:47.838235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-65572afb-d393-4e63-873c-1de52eb2de30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:47.839303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-65572afb-d393-4e63-873c-1de52eb2de30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:47.845862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65572afb-d393-4e63-873c-1de52eb2de30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:47.846314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65572afb-d393-4e63-873c-1de52eb2de30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:47.847083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65572afb-d393-4e63-873c-1de52eb2de30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:47.847513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-65572afb-d393-4e63-873c-1de52eb2de30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:47.908340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-65572afb-d393-4e63-873c-1de52eb2de30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:47.916423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-65572afb-d393-4e63-873c-1de52eb2de30 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.083461 Jun 20 06:38:47.917020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 944/1816] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:47 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:48.933400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-58842120-1174-44e3-b321-f40226b6a581 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:48.934014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-58842120-1174-44e3-b321-f40226b6a581 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:48.940482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58842120-1174-44e3-b321-f40226b6a581 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:48.940936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58842120-1174-44e3-b321-f40226b6a581 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:48.941730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58842120-1174-44e3-b321-f40226b6a581 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:48.942170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58842120-1174-44e3-b321-f40226b6a581 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:49.003522 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-58842120-1174-44e3-b321-f40226b6a581 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:49.011499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-58842120-1174-44e3-b321-f40226b6a581 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082184 Jun 20 06:38:49.012071 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 873/1817] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:48 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:50.028667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-643014f8-c783-4886-ac32-196596e784fc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:50.029285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-643014f8-c783-4886-ac32-196596e784fc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:50.035975 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-643014f8-c783-4886-ac32-196596e784fc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:50.036439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-643014f8-c783-4886-ac32-196596e784fc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:50.037198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-643014f8-c783-4886-ac32-196596e784fc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:50.037703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-643014f8-c783-4886-ac32-196596e784fc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:50.099839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-643014f8-c783-4886-ac32-196596e784fc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:50.107662 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-643014f8-c783-4886-ac32-196596e784fc tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082956 Jun 20 06:38:50.108218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 945/1818] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:50 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:51.124921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4cb75c31-fa34-4535-8aa9-2f5e168c00f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:51.125479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4cb75c31-fa34-4535-8aa9-2f5e168c00f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:51.132090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4cb75c31-fa34-4535-8aa9-2f5e168c00f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:51.132546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4cb75c31-fa34-4535-8aa9-2f5e168c00f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:51.133313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4cb75c31-fa34-4535-8aa9-2f5e168c00f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:51.133777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4cb75c31-fa34-4535-8aa9-2f5e168c00f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:51.195000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4cb75c31-fa34-4535-8aa9-2f5e168c00f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:51.202439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4cb75c31-fa34-4535-8aa9-2f5e168c00f5 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081482 Jun 20 06:38:51.203011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 874/1819] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:51 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:52.218876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-09a6a1f3-fc61-49c3-bb9d-d1801af7aa99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:52.219424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-09a6a1f3-fc61-49c3-bb9d-d1801af7aa99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:52.225872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09a6a1f3-fc61-49c3-bb9d-d1801af7aa99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:52.226321 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09a6a1f3-fc61-49c3-bb9d-d1801af7aa99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:52.227085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09a6a1f3-fc61-49c3-bb9d-d1801af7aa99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:52.227523 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09a6a1f3-fc61-49c3-bb9d-d1801af7aa99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:52.288389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-09a6a1f3-fc61-49c3-bb9d-d1801af7aa99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:52.296583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-09a6a1f3-fc61-49c3-bb9d-d1801af7aa99 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081657 Jun 20 06:38:52.297146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 946/1820] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:52 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:53.313770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e91e2903-b169-42ce-93b9-0de269c1fc72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:53.314383 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e91e2903-b169-42ce-93b9-0de269c1fc72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:53.320907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e91e2903-b169-42ce-93b9-0de269c1fc72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:53.321362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e91e2903-b169-42ce-93b9-0de269c1fc72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:53.322784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e91e2903-b169-42ce-93b9-0de269c1fc72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:53.323203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e91e2903-b169-42ce-93b9-0de269c1fc72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:53.383064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e91e2903-b169-42ce-93b9-0de269c1fc72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:53.391227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e91e2903-b169-42ce-93b9-0de269c1fc72 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.081519 Jun 20 06:38:53.391796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 875/1821] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:53 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:54.409704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-50b81933-80d7-4e20-add8-ee8c20bb3dfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:54.410297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-50b81933-80d7-4e20-add8-ee8c20bb3dfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:54.418950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50b81933-80d7-4e20-add8-ee8c20bb3dfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:54.419715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50b81933-80d7-4e20-add8-ee8c20bb3dfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:54.421033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50b81933-80d7-4e20-add8-ee8c20bb3dfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:54.421812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50b81933-80d7-4e20-add8-ee8c20bb3dfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:54.493318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-50b81933-80d7-4e20-add8-ee8c20bb3dfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:54.501000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-50b81933-80d7-4e20-add8-ee8c20bb3dfb tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.096517 Jun 20 06:38:54.501599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 947/1822] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:54 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:38:55.519151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-52f6dd5f-d370-4f75-b282-25f955dc8621 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:55.519802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-52f6dd5f-d370-4f75-b282-25f955dc8621 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:55.526370 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52f6dd5f-d370-4f75-b282-25f955dc8621 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:55.526810 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52f6dd5f-d370-4f75-b282-25f955dc8621 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:55.527564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52f6dd5f-d370-4f75-b282-25f955dc8621 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:55.527991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52f6dd5f-d370-4f75-b282-25f955dc8621 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:55.590171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-52f6dd5f-d370-4f75-b282-25f955dc8621 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:55.597585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-52f6dd5f-d370-4f75-b282-25f955dc8621 tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082275 Jun 20 06:38:55.598147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 876/1823] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:55 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:38:56.614850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9f0fe038-ef9d-4c14-9642-0d8efa3efc1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:56.615409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9f0fe038-ef9d-4c14-9642-0d8efa3efc1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:56.621995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9f0fe038-ef9d-4c14-9642-0d8efa3efc1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:56.622448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9f0fe038-ef9d-4c14-9642-0d8efa3efc1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:56.623385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9f0fe038-ef9d-4c14-9642-0d8efa3efc1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:56.623829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9f0fe038-ef9d-4c14-9642-0d8efa3efc1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:56.686106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9f0fe038-ef9d-4c14-9642-0d8efa3efc1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:56.693468 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9f0fe038-ef9d-4c14-9642-0d8efa3efc1e tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082497 Jun 20 06:38:56.694029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 948/1824] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:56 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:57.710909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-114a5bc4-bd06-4415-8357-23dd32e8984f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:57.711552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-114a5bc4-bd06-4415-8357-23dd32e8984f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:57.718965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-114a5bc4-bd06-4415-8357-23dd32e8984f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:57.719416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-114a5bc4-bd06-4415-8357-23dd32e8984f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:57.720176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-114a5bc4-bd06-4415-8357-23dd32e8984f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:57.720613 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-114a5bc4-bd06-4415-8357-23dd32e8984f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:57.782274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-114a5bc4-bd06-4415-8357-23dd32e8984f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:57.789737 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-114a5bc4-bd06-4415-8357-23dd32e8984f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.082686 Jun 20 06:38:57.791070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 877/1825] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:57 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:58.807638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d66b6a31-e6ac-4f82-a2e8-1ffb9636886d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:58.808246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d66b6a31-e6ac-4f82-a2e8-1ffb9636886d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] [instance: df0ade09-352b-4eb4-8c02-2bc3e8ed1c19] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:38:58.815106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d66b6a31-e6ac-4f82-a2e8-1ffb9636886d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:58.815550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d66b6a31-e6ac-4f82-a2e8-1ffb9636886d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:58.816310 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d66b6a31-e6ac-4f82-a2e8-1ffb9636886d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:38:58.816744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d66b6a31-e6ac-4f82-a2e8-1ffb9636886d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:38:58.884669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d66b6a31-e6ac-4f82-a2e8-1ffb9636886d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571d90a992034d7ea37016cee355a716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0346509d863b4c7bb2534206aa76fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:38:58.893576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d66b6a31-e6ac-4f82-a2e8-1ffb9636886d tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19" status: 200 len: 1213 microversion: 2.1 time: 0.089969 Jun 20 06:38:58.894137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 949/1826] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:38:58 2022] GET /compute/v2.1/servers/df0ade09-352b-4eb4-8c02-2bc3e8ed1c19 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:38:59.062443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-98a7f0e0-d173-4386-b67c-0a96fc5c4f8f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] Calling method '.version_select at 0x7f7a7a784ca0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:38:59.084156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-98a7f0e0-d173-4386-b67c-0a96fc5c4f8f tempest-TestShelveInstance-411942581 tempest-TestShelveInstance-411942581-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-388905979" status: 202 len: 0 microversion: 2.1 time: 0.025417 Jun 20 06:38:59.084964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 878/1827] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jun 20 06:38:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-388905979 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:39:40.099568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:39:40.100202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:39:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:39:58.330087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:39:58.330799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:39:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:40:11.137012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=13 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:11.137795 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=41 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:11.142242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-833a9883-4260-4bab-8daf-41afdde80072 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:11.142760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-833a9883-4260-4bab-8daf-41afdde80072 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:11.149765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-833a9883-4260-4bab-8daf-41afdde80072 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:11.150216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-833a9883-4260-4bab-8daf-41afdde80072 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:11.150983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-833a9883-4260-4bab-8daf-41afdde80072 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:11.151429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-833a9883-4260-4bab-8daf-41afdde80072 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:11.177322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-833a9883-4260-4bab-8daf-41afdde80072 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:40:11.253989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-833a9883-4260-4bab-8daf-41afdde80072 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 204 len: 0 microversion: 2.1 time: 0.118409 Jun 20 06:40:11.254726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 950/1828] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:40:11 2022] DELETE /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:40:11.261402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=47 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:11.262202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:11.266771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7eefae3b-c627-4ce2-9f77-755c7745f51d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:11.267460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7eefae3b-c627-4ce2-9f77-755c7745f51d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:11.274883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7eefae3b-c627-4ce2-9f77-755c7745f51d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:11.275332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7eefae3b-c627-4ce2-9f77-755c7745f51d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:11.276104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7eefae3b-c627-4ce2-9f77-755c7745f51d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:11.276545 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7eefae3b-c627-4ce2-9f77-755c7745f51d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:11.409221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7eefae3b-c627-4ce2-9f77-755c7745f51d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:11.417687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7eefae3b-c627-4ce2-9f77-755c7745f51d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.157850 Jun 20 06:40:11.418372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 879/1829] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:11 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:12.436121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-21000be0-5457-478d-93a8-ba73a3ff8fed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:12.436823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-21000be0-5457-478d-93a8-ba73a3ff8fed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:12.444595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21000be0-5457-478d-93a8-ba73a3ff8fed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:12.445035 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21000be0-5457-478d-93a8-ba73a3ff8fed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:12.445824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21000be0-5457-478d-93a8-ba73a3ff8fed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:12.446283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21000be0-5457-478d-93a8-ba73a3ff8fed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:12.582901 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-21000be0-5457-478d-93a8-ba73a3ff8fed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:12.590820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-21000be0-5457-478d-93a8-ba73a3ff8fed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.159509 Jun 20 06:40:12.591378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 951/1830] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:12 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:13.608283 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7a3100ef-7bb8-4ad6-99b8-5775b7aa6e0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:13.608849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7a3100ef-7bb8-4ad6-99b8-5775b7aa6e0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:13.615357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a3100ef-7bb8-4ad6-99b8-5775b7aa6e0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:13.615804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a3100ef-7bb8-4ad6-99b8-5775b7aa6e0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:13.616561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a3100ef-7bb8-4ad6-99b8-5775b7aa6e0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:13.616999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a3100ef-7bb8-4ad6-99b8-5775b7aa6e0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:13.750000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7a3100ef-7bb8-4ad6-99b8-5775b7aa6e0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:13.757984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7a3100ef-7bb8-4ad6-99b8-5775b7aa6e0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153652 Jun 20 06:40:13.758554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 880/1831] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:13 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:14.774824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6e060aca-6e34-44e3-afab-9fa26ea9737f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:14.775440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6e060aca-6e34-44e3-afab-9fa26ea9737f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:14.782000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e060aca-6e34-44e3-afab-9fa26ea9737f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:14.782444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e060aca-6e34-44e3-afab-9fa26ea9737f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:14.783221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e060aca-6e34-44e3-afab-9fa26ea9737f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:14.783650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e060aca-6e34-44e3-afab-9fa26ea9737f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:14.915121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6e060aca-6e34-44e3-afab-9fa26ea9737f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:14.924142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6e060aca-6e34-44e3-afab-9fa26ea9737f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153265 Jun 20 06:40:14.924701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 952/1832] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:14 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:15.940791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c5d56e0e-0b8a-49ae-a5e1-3f0e07e8a473 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:15.941404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c5d56e0e-0b8a-49ae-a5e1-3f0e07e8a473 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:15.947389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c5d56e0e-0b8a-49ae-a5e1-3f0e07e8a473 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:15.947837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c5d56e0e-0b8a-49ae-a5e1-3f0e07e8a473 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:15.948580 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c5d56e0e-0b8a-49ae-a5e1-3f0e07e8a473 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:15.949009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c5d56e0e-0b8a-49ae-a5e1-3f0e07e8a473 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:16.078759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c5d56e0e-0b8a-49ae-a5e1-3f0e07e8a473 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:16.086753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c5d56e0e-0b8a-49ae-a5e1-3f0e07e8a473 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149932 Jun 20 06:40:16.087320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 881/1833] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:15 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:17.103805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a834667-23e3-4312-a142-10011637adf4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:17.104343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8a834667-23e3-4312-a142-10011637adf4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:17.110936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a834667-23e3-4312-a142-10011637adf4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:17.111381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a834667-23e3-4312-a142-10011637adf4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:17.112137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a834667-23e3-4312-a142-10011637adf4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:17.112567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a834667-23e3-4312-a142-10011637adf4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:17.244815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a834667-23e3-4312-a142-10011637adf4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:17.252611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a834667-23e3-4312-a142-10011637adf4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152799 Jun 20 06:40:17.253174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 953/1834] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:17 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:18.273396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-412bb039-5ddd-49f0-ac93-7c2c5f10af16 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:18.274320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-412bb039-5ddd-49f0-ac93-7c2c5f10af16 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:18.283679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-412bb039-5ddd-49f0-ac93-7c2c5f10af16 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:18.284344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-412bb039-5ddd-49f0-ac93-7c2c5f10af16 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:18.285247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-412bb039-5ddd-49f0-ac93-7c2c5f10af16 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:18.285710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-412bb039-5ddd-49f0-ac93-7c2c5f10af16 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:18.413767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-412bb039-5ddd-49f0-ac93-7c2c5f10af16 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:18.422203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-412bb039-5ddd-49f0-ac93-7c2c5f10af16 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.154742 Jun 20 06:40:18.422782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 882/1835] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:18 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:19.440081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5ede28c3-8694-471d-be2e-1aefdc983654 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:19.440691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5ede28c3-8694-471d-be2e-1aefdc983654 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:19.447144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ede28c3-8694-471d-be2e-1aefdc983654 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:19.447588 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ede28c3-8694-471d-be2e-1aefdc983654 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:19.448352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ede28c3-8694-471d-be2e-1aefdc983654 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:19.448784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ede28c3-8694-471d-be2e-1aefdc983654 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:19.578438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5ede28c3-8694-471d-be2e-1aefdc983654 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:19.586253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5ede28c3-8694-471d-be2e-1aefdc983654 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151102 Jun 20 06:40:19.586748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 954/1836] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:19 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:20.603715 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a00a5ab3-7184-49c9-a3de-c6c25ffe1376 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:20.604267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a00a5ab3-7184-49c9-a3de-c6c25ffe1376 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:20.610723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a00a5ab3-7184-49c9-a3de-c6c25ffe1376 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:20.611165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a00a5ab3-7184-49c9-a3de-c6c25ffe1376 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:20.611919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a00a5ab3-7184-49c9-a3de-c6c25ffe1376 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:20.612350 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a00a5ab3-7184-49c9-a3de-c6c25ffe1376 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:20.746553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a00a5ab3-7184-49c9-a3de-c6c25ffe1376 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:20.756092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a00a5ab3-7184-49c9-a3de-c6c25ffe1376 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.156290 Jun 20 06:40:20.756657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 883/1837] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:20 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:21.773516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a4af2a2-eac7-4173-a5ca-d9a5d48c2704 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:21.774191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2a4af2a2-eac7-4173-a5ca-d9a5d48c2704 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:21.780625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a4af2a2-eac7-4173-a5ca-d9a5d48c2704 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:21.781759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a4af2a2-eac7-4173-a5ca-d9a5d48c2704 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:21.782848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a4af2a2-eac7-4173-a5ca-d9a5d48c2704 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:21.783291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a4af2a2-eac7-4173-a5ca-d9a5d48c2704 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:21.913590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2a4af2a2-eac7-4173-a5ca-d9a5d48c2704 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:21.921370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2a4af2a2-eac7-4173-a5ca-d9a5d48c2704 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151747 Jun 20 06:40:21.922136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 955/1838] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:21 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:22.939482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-249976c0-972a-4f0f-a8d9-594bcff6266b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:22.940097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-249976c0-972a-4f0f-a8d9-594bcff6266b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:22.946649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-249976c0-972a-4f0f-a8d9-594bcff6266b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:22.947096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-249976c0-972a-4f0f-a8d9-594bcff6266b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:22.947855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-249976c0-972a-4f0f-a8d9-594bcff6266b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:22.948293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-249976c0-972a-4f0f-a8d9-594bcff6266b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:23.082759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-249976c0-972a-4f0f-a8d9-594bcff6266b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:23.090673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-249976c0-972a-4f0f-a8d9-594bcff6266b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.155776 Jun 20 06:40:23.091242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 884/1839] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:22 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:24.110879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e28d940b-2989-4836-8771-d811eec8464c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:24.111493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e28d940b-2989-4836-8771-d811eec8464c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:24.117998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e28d940b-2989-4836-8771-d811eec8464c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:24.118445 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e28d940b-2989-4836-8771-d811eec8464c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:24.119200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e28d940b-2989-4836-8771-d811eec8464c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:24.119636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e28d940b-2989-4836-8771-d811eec8464c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:24.257263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e28d940b-2989-4836-8771-d811eec8464c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:24.266692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e28d940b-2989-4836-8771-d811eec8464c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.158728 Jun 20 06:40:24.267283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 956/1840] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:24 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:25.285960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bc5c4c45-f2e0-4fa6-8863-63376713b593 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:25.286599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bc5c4c45-f2e0-4fa6-8863-63376713b593 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:25.293033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc5c4c45-f2e0-4fa6-8863-63376713b593 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:25.293507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc5c4c45-f2e0-4fa6-8863-63376713b593 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:25.294269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc5c4c45-f2e0-4fa6-8863-63376713b593 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:25.294707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bc5c4c45-f2e0-4fa6-8863-63376713b593 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:25.436996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bc5c4c45-f2e0-4fa6-8863-63376713b593 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:25.446273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bc5c4c45-f2e0-4fa6-8863-63376713b593 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.164169 Jun 20 06:40:25.446842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 885/1841] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:25 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:26.464050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3f723ef0-5f01-478b-9dfd-7c9ff7cc6cd8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:26.464663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3f723ef0-5f01-478b-9dfd-7c9ff7cc6cd8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:26.471403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f723ef0-5f01-478b-9dfd-7c9ff7cc6cd8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:26.471853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f723ef0-5f01-478b-9dfd-7c9ff7cc6cd8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:26.472604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f723ef0-5f01-478b-9dfd-7c9ff7cc6cd8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:26.473039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f723ef0-5f01-478b-9dfd-7c9ff7cc6cd8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:26.602385 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3f723ef0-5f01-478b-9dfd-7c9ff7cc6cd8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:26.610152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3f723ef0-5f01-478b-9dfd-7c9ff7cc6cd8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149928 Jun 20 06:40:26.610715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 957/1842] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:26 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:27.628030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8468da97-377c-4fe0-a437-b920cb7b899f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:27.628666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8468da97-377c-4fe0-a437-b920cb7b899f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:27.635089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8468da97-377c-4fe0-a437-b920cb7b899f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:27.635537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8468da97-377c-4fe0-a437-b920cb7b899f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:27.636291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8468da97-377c-4fe0-a437-b920cb7b899f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:27.636726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8468da97-377c-4fe0-a437-b920cb7b899f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:27.764685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8468da97-377c-4fe0-a437-b920cb7b899f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:27.773309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8468da97-377c-4fe0-a437-b920cb7b899f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149968 Jun 20 06:40:27.773899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 886/1843] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:27 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:28.790866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e5b40f4a-8be2-47f6-af2c-fa5e026e137f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:28.791472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e5b40f4a-8be2-47f6-af2c-fa5e026e137f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:28.798329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e5b40f4a-8be2-47f6-af2c-fa5e026e137f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:28.798769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e5b40f4a-8be2-47f6-af2c-fa5e026e137f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:28.799517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e5b40f4a-8be2-47f6-af2c-fa5e026e137f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:28.799942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e5b40f4a-8be2-47f6-af2c-fa5e026e137f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:28.928447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e5b40f4a-8be2-47f6-af2c-fa5e026e137f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:28.936377 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e5b40f4a-8be2-47f6-af2c-fa5e026e137f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149376 Jun 20 06:40:28.936937 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 958/1844] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:28 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:29.954891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7a98876f-8a16-45f4-b4a2-deb46f225f77 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:29.955504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7a98876f-8a16-45f4-b4a2-deb46f225f77 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:29.961943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a98876f-8a16-45f4-b4a2-deb46f225f77 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:29.962393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a98876f-8a16-45f4-b4a2-deb46f225f77 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:29.963153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a98876f-8a16-45f4-b4a2-deb46f225f77 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:29.963589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a98876f-8a16-45f4-b4a2-deb46f225f77 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:30.091925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7a98876f-8a16-45f4-b4a2-deb46f225f77 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:30.100358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7a98876f-8a16-45f4-b4a2-deb46f225f77 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149975 Jun 20 06:40:30.100913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 887/1845] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:29 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:31.119313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-41d5971f-1ecb-45ab-b3d1-0aca957ba82a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:31.119878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-41d5971f-1ecb-45ab-b3d1-0aca957ba82a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:31.128187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-41d5971f-1ecb-45ab-b3d1-0aca957ba82a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:31.128632 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-41d5971f-1ecb-45ab-b3d1-0aca957ba82a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:31.129424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-41d5971f-1ecb-45ab-b3d1-0aca957ba82a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:31.129858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-41d5971f-1ecb-45ab-b3d1-0aca957ba82a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:31.266785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-41d5971f-1ecb-45ab-b3d1-0aca957ba82a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:31.274773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-41d5971f-1ecb-45ab-b3d1-0aca957ba82a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.160275 Jun 20 06:40:31.275343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 959/1846] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:31 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:32.292446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bbad535c-5ca9-42da-9c63-0412dc78052a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:32.293054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bbad535c-5ca9-42da-9c63-0412dc78052a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:32.300091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbad535c-5ca9-42da-9c63-0412dc78052a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:32.300542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbad535c-5ca9-42da-9c63-0412dc78052a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:32.301293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbad535c-5ca9-42da-9c63-0412dc78052a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:32.301799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbad535c-5ca9-42da-9c63-0412dc78052a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:32.430150 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bbad535c-5ca9-42da-9c63-0412dc78052a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:32.438379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bbad535c-5ca9-42da-9c63-0412dc78052a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149884 Jun 20 06:40:32.438938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 888/1847] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:32 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:33.456055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ac35e148-ca61-47d4-a38e-3125a043b848 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:33.456658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ac35e148-ca61-47d4-a38e-3125a043b848 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:33.462699 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac35e148-ca61-47d4-a38e-3125a043b848 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:33.463142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac35e148-ca61-47d4-a38e-3125a043b848 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:33.463892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac35e148-ca61-47d4-a38e-3125a043b848 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:33.464330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ac35e148-ca61-47d4-a38e-3125a043b848 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:33.604410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ac35e148-ca61-47d4-a38e-3125a043b848 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:33.612381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ac35e148-ca61-47d4-a38e-3125a043b848 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.161015 Jun 20 06:40:33.612948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 960/1848] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:33 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:34.629621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-848ac5eb-66b7-49c4-800e-214959515797 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:34.630265 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-848ac5eb-66b7-49c4-800e-214959515797 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:34.636756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-848ac5eb-66b7-49c4-800e-214959515797 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:34.637198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-848ac5eb-66b7-49c4-800e-214959515797 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:34.637975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-848ac5eb-66b7-49c4-800e-214959515797 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:34.638690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-848ac5eb-66b7-49c4-800e-214959515797 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:34.771216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-848ac5eb-66b7-49c4-800e-214959515797 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:34.779184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-848ac5eb-66b7-49c4-800e-214959515797 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153446 Jun 20 06:40:34.779746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 889/1849] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:34 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:35.797246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-10f071e3-7892-4772-a2bd-32cca087618c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:35.798432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-10f071e3-7892-4772-a2bd-32cca087618c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:35.806441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10f071e3-7892-4772-a2bd-32cca087618c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:35.807069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10f071e3-7892-4772-a2bd-32cca087618c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:35.808096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10f071e3-7892-4772-a2bd-32cca087618c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:35.808542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10f071e3-7892-4772-a2bd-32cca087618c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:35.942471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-10f071e3-7892-4772-a2bd-32cca087618c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:35.950331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-10f071e3-7892-4772-a2bd-32cca087618c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.157159 Jun 20 06:40:35.950902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 961/1850] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:35 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:36.968118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1a222248-6e3b-40ed-99af-dc6c716dcbd7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:36.968759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1a222248-6e3b-40ed-99af-dc6c716dcbd7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:36.975817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a222248-6e3b-40ed-99af-dc6c716dcbd7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:36.976267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a222248-6e3b-40ed-99af-dc6c716dcbd7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:36.977024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a222248-6e3b-40ed-99af-dc6c716dcbd7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:36.977487 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a222248-6e3b-40ed-99af-dc6c716dcbd7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:37.104802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1a222248-6e3b-40ed-99af-dc6c716dcbd7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:37.113593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1a222248-6e3b-40ed-99af-dc6c716dcbd7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149384 Jun 20 06:40:37.114155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 890/1851] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:36 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:38.131951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-30f3380d-d2e6-48c7-9ab5-9907b971b512 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:38.132555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-30f3380d-d2e6-48c7-9ab5-9907b971b512 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:38.139265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-30f3380d-d2e6-48c7-9ab5-9907b971b512 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:38.139715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-30f3380d-d2e6-48c7-9ab5-9907b971b512 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:38.140473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-30f3380d-d2e6-48c7-9ab5-9907b971b512 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:38.140911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-30f3380d-d2e6-48c7-9ab5-9907b971b512 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:38.271695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-30f3380d-d2e6-48c7-9ab5-9907b971b512 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:38.279443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-30f3380d-d2e6-48c7-9ab5-9907b971b512 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151327 Jun 20 06:40:38.280000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 962/1852] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:38 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:39.297159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4f6bd679-3cf2-4c78-9529-6c3b07517057 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:39.297802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4f6bd679-3cf2-4c78-9529-6c3b07517057 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:39.304236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f6bd679-3cf2-4c78-9529-6c3b07517057 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:39.304678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f6bd679-3cf2-4c78-9529-6c3b07517057 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:39.305458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f6bd679-3cf2-4c78-9529-6c3b07517057 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:39.305891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f6bd679-3cf2-4c78-9529-6c3b07517057 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:39.434285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4f6bd679-3cf2-4c78-9529-6c3b07517057 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:39.442850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4f6bd679-3cf2-4c78-9529-6c3b07517057 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149759 Jun 20 06:40:39.443411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 891/1853] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:39 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:40.460346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c4e94659-6691-429a-bb99-a99812357808 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:40.460950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c4e94659-6691-429a-bb99-a99812357808 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:40.467637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4e94659-6691-429a-bb99-a99812357808 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:40.468387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4e94659-6691-429a-bb99-a99812357808 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:40.469579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4e94659-6691-429a-bb99-a99812357808 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:40.470850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4e94659-6691-429a-bb99-a99812357808 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:40.603983 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c4e94659-6691-429a-bb99-a99812357808 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:40.613322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c4e94659-6691-429a-bb99-a99812357808 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.156788 Jun 20 06:40:40.614023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 963/1854] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:40 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:41.630443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c419deff-8a53-462b-a447-7588a1d033ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:41.631062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c419deff-8a53-462b-a447-7588a1d033ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:41.633369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=27 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:41.638997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c419deff-8a53-462b-a447-7588a1d033ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:41.639444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c419deff-8a53-462b-a447-7588a1d033ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:41.640207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c419deff-8a53-462b-a447-7588a1d033ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:41.640641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c419deff-8a53-462b-a447-7588a1d033ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:41.643495 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=79 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:41.769429 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c419deff-8a53-462b-a447-7588a1d033ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:41.777267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c419deff-8a53-462b-a447-7588a1d033ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150648 Jun 20 06:40:41.777854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 892/1855] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:41 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:42.794764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fae5c9df-0cf6-40c5-b74d-8a67e1593820 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:42.795395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fae5c9df-0cf6-40c5-b74d-8a67e1593820 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:42.797810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:42.803705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fae5c9df-0cf6-40c5-b74d-8a67e1593820 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:42.804155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fae5c9df-0cf6-40c5-b74d-8a67e1593820 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:42.804952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fae5c9df-0cf6-40c5-b74d-8a67e1593820 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:42.805448 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fae5c9df-0cf6-40c5-b74d-8a67e1593820 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:42.810212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:40:42.936990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fae5c9df-0cf6-40c5-b74d-8a67e1593820 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:42.944811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fae5c9df-0cf6-40c5-b74d-8a67e1593820 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153869 Jun 20 06:40:42.945608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 964/1856] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:42 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:40:43.962382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6cfe03ff-8e92-40d6-a56a-5c6b1002ece1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:43.962945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6cfe03ff-8e92-40d6-a56a-5c6b1002ece1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:43.969511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cfe03ff-8e92-40d6-a56a-5c6b1002ece1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:43.969968 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cfe03ff-8e92-40d6-a56a-5c6b1002ece1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:43.970743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cfe03ff-8e92-40d6-a56a-5c6b1002ece1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:43.971182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cfe03ff-8e92-40d6-a56a-5c6b1002ece1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:44.102791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6cfe03ff-8e92-40d6-a56a-5c6b1002ece1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:44.110669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6cfe03ff-8e92-40d6-a56a-5c6b1002ece1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152226 Jun 20 06:40:44.111227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 893/1857] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:43 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:40:45.128011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0d77067a-fe04-4baf-b527-23a21600eb53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:45.128886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0d77067a-fe04-4baf-b527-23a21600eb53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:45.136999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d77067a-fe04-4baf-b527-23a21600eb53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:45.137620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d77067a-fe04-4baf-b527-23a21600eb53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:45.138855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d77067a-fe04-4baf-b527-23a21600eb53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:45.139510 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d77067a-fe04-4baf-b527-23a21600eb53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:45.266225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d77067a-fe04-4baf-b527-23a21600eb53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:45.274246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0d77067a-fe04-4baf-b527-23a21600eb53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150330 Jun 20 06:40:45.274899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 965/1858] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:45 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:46.291485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b4965883-c295-46a1-858e-8f5ca0e40247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:46.292124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b4965883-c295-46a1-858e-8f5ca0e40247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:46.298436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4965883-c295-46a1-858e-8f5ca0e40247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:46.298880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4965883-c295-46a1-858e-8f5ca0e40247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:46.299632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4965883-c295-46a1-858e-8f5ca0e40247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:46.300062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b4965883-c295-46a1-858e-8f5ca0e40247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:46.456735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b4965883-c295-46a1-858e-8f5ca0e40247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:46.464845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b4965883-c295-46a1-858e-8f5ca0e40247 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.177331 Jun 20 06:40:46.465442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 894/1859] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:46 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:47.483030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bea50c9e-da87-4667-9aaa-4ba19e05c72c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:47.483633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bea50c9e-da87-4667-9aaa-4ba19e05c72c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:47.490909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bea50c9e-da87-4667-9aaa-4ba19e05c72c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:47.491348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bea50c9e-da87-4667-9aaa-4ba19e05c72c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:47.492094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bea50c9e-da87-4667-9aaa-4ba19e05c72c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:47.492522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bea50c9e-da87-4667-9aaa-4ba19e05c72c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:47.623173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bea50c9e-da87-4667-9aaa-4ba19e05c72c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:47.631320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bea50c9e-da87-4667-9aaa-4ba19e05c72c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152244 Jun 20 06:40:47.631876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 966/1860] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:47 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:48.648559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d513d73-e54d-44e0-890c-9481d3af2e53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:48.649199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d513d73-e54d-44e0-890c-9481d3af2e53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:48.655769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d513d73-e54d-44e0-890c-9481d3af2e53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:48.656213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d513d73-e54d-44e0-890c-9481d3af2e53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:48.656972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d513d73-e54d-44e0-890c-9481d3af2e53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:48.657417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d513d73-e54d-44e0-890c-9481d3af2e53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:48.788636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d513d73-e54d-44e0-890c-9481d3af2e53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:48.796547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d513d73-e54d-44e0-890c-9481d3af2e53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152031 Jun 20 06:40:48.797110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 895/1861] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:48 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:49.813576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9887b365-5cae-4a1e-ad19-13f2af4f7648 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:49.814184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9887b365-5cae-4a1e-ad19-13f2af4f7648 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:49.821122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9887b365-5cae-4a1e-ad19-13f2af4f7648 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:49.821597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9887b365-5cae-4a1e-ad19-13f2af4f7648 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:49.822354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9887b365-5cae-4a1e-ad19-13f2af4f7648 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:49.822787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9887b365-5cae-4a1e-ad19-13f2af4f7648 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:49.963506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9887b365-5cae-4a1e-ad19-13f2af4f7648 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:49.971411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9887b365-5cae-4a1e-ad19-13f2af4f7648 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.161749 Jun 20 06:40:49.971963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 967/1862] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:49 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:50.989637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-93bf048d-82b0-4a9a-8922-28f8dcfc3b79 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:50.990903 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-93bf048d-82b0-4a9a-8922-28f8dcfc3b79 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:50.997651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93bf048d-82b0-4a9a-8922-28f8dcfc3b79 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:50.998101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93bf048d-82b0-4a9a-8922-28f8dcfc3b79 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:50.998864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93bf048d-82b0-4a9a-8922-28f8dcfc3b79 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:50.999303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93bf048d-82b0-4a9a-8922-28f8dcfc3b79 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:51.129010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93bf048d-82b0-4a9a-8922-28f8dcfc3b79 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:51.137514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-93bf048d-82b0-4a9a-8922-28f8dcfc3b79 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152892 Jun 20 06:40:51.138076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 896/1863] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:50 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:52.155867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad247da2-af9b-40cf-8fa8-027a250455b8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:52.156482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ad247da2-af9b-40cf-8fa8-027a250455b8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:52.163128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad247da2-af9b-40cf-8fa8-027a250455b8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:52.163581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad247da2-af9b-40cf-8fa8-027a250455b8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:52.164394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad247da2-af9b-40cf-8fa8-027a250455b8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:52.164785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad247da2-af9b-40cf-8fa8-027a250455b8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:52.294265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ad247da2-af9b-40cf-8fa8-027a250455b8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:52.302002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ad247da2-af9b-40cf-8fa8-027a250455b8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150474 Jun 20 06:40:52.302571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 968/1864] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:52 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:53.319114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8df564b-f848-47f8-8231-2710165fbe0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:53.319721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8df564b-f848-47f8-8231-2710165fbe0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:53.327481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8df564b-f848-47f8-8231-2710165fbe0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:53.327930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8df564b-f848-47f8-8231-2710165fbe0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:53.328699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8df564b-f848-47f8-8231-2710165fbe0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:53.329133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8df564b-f848-47f8-8231-2710165fbe0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:53.464598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8df564b-f848-47f8-8231-2710165fbe0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:53.472509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8df564b-f848-47f8-8231-2710165fbe0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.157293 Jun 20 06:40:53.473072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 897/1865] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:53 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:54.490096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-431ba5ae-f7ea-4df8-bc37-4533fb82cac6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:54.490701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-431ba5ae-f7ea-4df8-bc37-4533fb82cac6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:54.497104 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-431ba5ae-f7ea-4df8-bc37-4533fb82cac6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:54.497577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-431ba5ae-f7ea-4df8-bc37-4533fb82cac6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:54.498326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-431ba5ae-f7ea-4df8-bc37-4533fb82cac6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:54.498746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-431ba5ae-f7ea-4df8-bc37-4533fb82cac6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:54.636846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-431ba5ae-f7ea-4df8-bc37-4533fb82cac6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:54.644950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-431ba5ae-f7ea-4df8-bc37-4533fb82cac6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.158725 Jun 20 06:40:54.645535 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 969/1866] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:54 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:55.662280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91c00d43-d7e6-4bb7-8e31-f1688015e717 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:55.662900 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91c00d43-d7e6-4bb7-8e31-f1688015e717 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:55.670144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c00d43-d7e6-4bb7-8e31-f1688015e717 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:55.670599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c00d43-d7e6-4bb7-8e31-f1688015e717 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:55.671364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c00d43-d7e6-4bb7-8e31-f1688015e717 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:55.671803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c00d43-d7e6-4bb7-8e31-f1688015e717 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:55.800559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-91c00d43-d7e6-4bb7-8e31-f1688015e717 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:55.808732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91c00d43-d7e6-4bb7-8e31-f1688015e717 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150320 Jun 20 06:40:55.809335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 898/1867] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:55 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:56.826585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-928046ef-bb8b-4409-b150-826e53ce9595 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:56.827179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-928046ef-bb8b-4409-b150-826e53ce9595 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:56.833771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-928046ef-bb8b-4409-b150-826e53ce9595 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:56.834220 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-928046ef-bb8b-4409-b150-826e53ce9595 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:56.834978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-928046ef-bb8b-4409-b150-826e53ce9595 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:56.835411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-928046ef-bb8b-4409-b150-826e53ce9595 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:56.963738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-928046ef-bb8b-4409-b150-826e53ce9595 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:56.971587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-928046ef-bb8b-4409-b150-826e53ce9595 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148838 Jun 20 06:40:56.972259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 970/1868] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:56 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:57.990470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e28bd267-3fc4-4059-8ed0-bf4c3fff59fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:57.991097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e28bd267-3fc4-4059-8ed0-bf4c3fff59fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:57.998467 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e28bd267-3fc4-4059-8ed0-bf4c3fff59fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:57.998920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e28bd267-3fc4-4059-8ed0-bf4c3fff59fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:57.999691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e28bd267-3fc4-4059-8ed0-bf4c3fff59fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:58.000165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e28bd267-3fc4-4059-8ed0-bf4c3fff59fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:58.129369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e28bd267-3fc4-4059-8ed0-bf4c3fff59fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:58.137885 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e28bd267-3fc4-4059-8ed0-bf4c3fff59fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151245 Jun 20 06:40:58.138712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 899/1869] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:57 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:40:59.156224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-52dfc961-e048-43dc-bde4-0323265db078 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:40:59.156833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-52dfc961-e048-43dc-bde4-0323265db078 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:40:59.163160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52dfc961-e048-43dc-bde4-0323265db078 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:59.163602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52dfc961-e048-43dc-bde4-0323265db078 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:59.164350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52dfc961-e048-43dc-bde4-0323265db078 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:40:59.164781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52dfc961-e048-43dc-bde4-0323265db078 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:40:59.295898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-52dfc961-e048-43dc-bde4-0323265db078 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:40:59.303810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-52dfc961-e048-43dc-bde4-0323265db078 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151428 Jun 20 06:40:59.304351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 971/1870] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:40:59 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:00.320017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b1174c3e-ec85-4b6b-8164-c01fc7b9e9ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:00.320633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b1174c3e-ec85-4b6b-8164-c01fc7b9e9ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:00.328300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1174c3e-ec85-4b6b-8164-c01fc7b9e9ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:00.328926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1174c3e-ec85-4b6b-8164-c01fc7b9e9ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:00.329872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1174c3e-ec85-4b6b-8164-c01fc7b9e9ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:00.330434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1174c3e-ec85-4b6b-8164-c01fc7b9e9ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:00.463879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1174c3e-ec85-4b6b-8164-c01fc7b9e9ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:00.471913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b1174c3e-ec85-4b6b-8164-c01fc7b9e9ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.155760 Jun 20 06:41:00.472475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 900/1871] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:00 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:01.489649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-80718676-8d0e-495b-a735-90b737141b99 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:01.490271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-80718676-8d0e-495b-a735-90b737141b99 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:01.496855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80718676-8d0e-495b-a735-90b737141b99 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:01.497303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80718676-8d0e-495b-a735-90b737141b99 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:01.498096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80718676-8d0e-495b-a735-90b737141b99 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:01.498529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-80718676-8d0e-495b-a735-90b737141b99 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:01.624727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-80718676-8d0e-495b-a735-90b737141b99 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:01.632594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-80718676-8d0e-495b-a735-90b737141b99 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146919 Jun 20 06:41:01.633159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 972/1872] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:01 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:02.650295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0e3c8358-3a6e-401f-ace6-d73d236045f5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:02.650925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0e3c8358-3a6e-401f-ace6-d73d236045f5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:02.657459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e3c8358-3a6e-401f-ace6-d73d236045f5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:02.657889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e3c8358-3a6e-401f-ace6-d73d236045f5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:02.658642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e3c8358-3a6e-401f-ace6-d73d236045f5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:02.659075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e3c8358-3a6e-401f-ace6-d73d236045f5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:02.787174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0e3c8358-3a6e-401f-ace6-d73d236045f5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:02.795392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0e3c8358-3a6e-401f-ace6-d73d236045f5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148955 Jun 20 06:41:02.795966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 901/1873] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:02 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:03.812735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-68215074-d500-4d2d-9fa1-7b9faa116068 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:03.813336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-68215074-d500-4d2d-9fa1-7b9faa116068 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:03.819446 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68215074-d500-4d2d-9fa1-7b9faa116068 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:03.819888 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68215074-d500-4d2d-9fa1-7b9faa116068 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:03.820637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68215074-d500-4d2d-9fa1-7b9faa116068 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:03.821087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68215074-d500-4d2d-9fa1-7b9faa116068 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:03.952139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-68215074-d500-4d2d-9fa1-7b9faa116068 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:03.959877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-68215074-d500-4d2d-9fa1-7b9faa116068 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150994 Jun 20 06:41:03.960433 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 973/1874] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:03 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:04.978099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e2ebd5e4-b896-4676-be67-8acc30289439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:04.978736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e2ebd5e4-b896-4676-be67-8acc30289439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:04.985179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2ebd5e4-b896-4676-be67-8acc30289439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:04.985662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2ebd5e4-b896-4676-be67-8acc30289439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:04.986424 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2ebd5e4-b896-4676-be67-8acc30289439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:04.986861 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2ebd5e4-b896-4676-be67-8acc30289439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:05.112614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e2ebd5e4-b896-4676-be67-8acc30289439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:05.120781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e2ebd5e4-b896-4676-be67-8acc30289439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147210 Jun 20 06:41:05.121338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 902/1875] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:04 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:06.138503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5a4cc8af-fff4-4a2f-96a6-980373f18831 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:06.139106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5a4cc8af-fff4-4a2f-96a6-980373f18831 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:06.145551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a4cc8af-fff4-4a2f-96a6-980373f18831 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:06.145993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a4cc8af-fff4-4a2f-96a6-980373f18831 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:06.146744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a4cc8af-fff4-4a2f-96a6-980373f18831 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:06.147171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a4cc8af-fff4-4a2f-96a6-980373f18831 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:06.279734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a4cc8af-fff4-4a2f-96a6-980373f18831 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:06.287633 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5a4cc8af-fff4-4a2f-96a6-980373f18831 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153214 Jun 20 06:41:06.288199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 974/1876] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:06 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:07.305052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3b1973e4-7217-47ee-a022-8ce380c57516 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:07.306164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3b1973e4-7217-47ee-a022-8ce380c57516 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:07.312908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b1973e4-7217-47ee-a022-8ce380c57516 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:07.313367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b1973e4-7217-47ee-a022-8ce380c57516 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:07.314152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b1973e4-7217-47ee-a022-8ce380c57516 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:07.314582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b1973e4-7217-47ee-a022-8ce380c57516 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:07.442803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b1973e4-7217-47ee-a022-8ce380c57516 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:07.450761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3b1973e4-7217-47ee-a022-8ce380c57516 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149517 Jun 20 06:41:07.451330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 903/1877] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:07 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:08.468249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df526b96-6605-407b-a281-d986a6563038 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:08.468855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-df526b96-6605-407b-a281-d986a6563038 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:08.475538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df526b96-6605-407b-a281-d986a6563038 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:08.476007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df526b96-6605-407b-a281-d986a6563038 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:08.476764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df526b96-6605-407b-a281-d986a6563038 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:08.477216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df526b96-6605-407b-a281-d986a6563038 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:08.609277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-df526b96-6605-407b-a281-d986a6563038 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:08.617029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-df526b96-6605-407b-a281-d986a6563038 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152636 Jun 20 06:41:08.617606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 975/1878] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:08 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:09.635143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ab6d57f6-5b2f-45d3-a0ab-437d2b615446 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:09.635780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ab6d57f6-5b2f-45d3-a0ab-437d2b615446 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:09.642652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab6d57f6-5b2f-45d3-a0ab-437d2b615446 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:09.643103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab6d57f6-5b2f-45d3-a0ab-437d2b615446 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:09.643876 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab6d57f6-5b2f-45d3-a0ab-437d2b615446 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:09.644317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab6d57f6-5b2f-45d3-a0ab-437d2b615446 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:10.011053 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ab6d57f6-5b2f-45d3-a0ab-437d2b615446 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:10.019157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ab6d57f6-5b2f-45d3-a0ab-437d2b615446 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.388473 Jun 20 06:41:10.019711 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 904/1879] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:09 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:11.036534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d66fb313-8fcb-4035-917e-cbd9621086a5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:11.037144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d66fb313-8fcb-4035-917e-cbd9621086a5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:11.043651 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d66fb313-8fcb-4035-917e-cbd9621086a5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:11.044100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d66fb313-8fcb-4035-917e-cbd9621086a5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:11.044865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d66fb313-8fcb-4035-917e-cbd9621086a5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:11.045298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d66fb313-8fcb-4035-917e-cbd9621086a5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:11.172458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d66fb313-8fcb-4035-917e-cbd9621086a5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:11.181021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d66fb313-8fcb-4035-917e-cbd9621086a5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147645 Jun 20 06:41:11.181615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 976/1880] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:11 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:12.198207 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-42f7be22-b303-4ce1-96d2-d4829d005dc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:12.198849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-42f7be22-b303-4ce1-96d2-d4829d005dc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:12.201135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:41:12.206534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42f7be22-b303-4ce1-96d2-d4829d005dc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:12.206987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42f7be22-b303-4ce1-96d2-d4829d005dc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:12.207755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42f7be22-b303-4ce1-96d2-d4829d005dc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:12.208203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42f7be22-b303-4ce1-96d2-d4829d005dc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:12.212887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:41:12.338689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-42f7be22-b303-4ce1-96d2-d4829d005dc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:12.347425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-42f7be22-b303-4ce1-96d2-d4829d005dc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153692 Jun 20 06:41:12.347986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 905/1881] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:12 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:13.363945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2f657a12-9afd-4700-ab3f-7c9648a2d6e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:13.364558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2f657a12-9afd-4700-ab3f-7c9648a2d6e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:13.366853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:41:13.373065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f657a12-9afd-4700-ab3f-7c9648a2d6e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:13.373613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f657a12-9afd-4700-ab3f-7c9648a2d6e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:13.374379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f657a12-9afd-4700-ab3f-7c9648a2d6e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:13.374815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f657a12-9afd-4700-ab3f-7c9648a2d6e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:13.377326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=78 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:41:13.502727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2f657a12-9afd-4700-ab3f-7c9648a2d6e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:13.511175 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2f657a12-9afd-4700-ab3f-7c9648a2d6e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151110 Jun 20 06:41:13.511736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 977/1882] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:13 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:14.528426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3ed974fc-747f-4c91-83a7-21c6f0db0a87 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:14.529204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3ed974fc-747f-4c91-83a7-21c6f0db0a87 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:14.535870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ed974fc-747f-4c91-83a7-21c6f0db0a87 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:14.536315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ed974fc-747f-4c91-83a7-21c6f0db0a87 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:14.537065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ed974fc-747f-4c91-83a7-21c6f0db0a87 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:14.537521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ed974fc-747f-4c91-83a7-21c6f0db0a87 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:14.681840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3ed974fc-747f-4c91-83a7-21c6f0db0a87 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:14.689843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3ed974fc-747f-4c91-83a7-21c6f0db0a87 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.165394 Jun 20 06:41:14.690412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 906/1883] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:14 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:15.706568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-54537884-8582-4a0f-8a93-25734a66447c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:15.707184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-54537884-8582-4a0f-8a93-25734a66447c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:15.714467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54537884-8582-4a0f-8a93-25734a66447c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:15.714964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54537884-8582-4a0f-8a93-25734a66447c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:15.715778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54537884-8582-4a0f-8a93-25734a66447c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:15.716212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54537884-8582-4a0f-8a93-25734a66447c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:15.850993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-54537884-8582-4a0f-8a93-25734a66447c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:15.859611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-54537884-8582-4a0f-8a93-25734a66447c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.156939 Jun 20 06:41:15.860181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 978/1884] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:15 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:16.875904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-731623ab-fd5a-435f-adbc-5069d606aedf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:16.876511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-731623ab-fd5a-435f-adbc-5069d606aedf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:16.883047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-731623ab-fd5a-435f-adbc-5069d606aedf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:16.883489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-731623ab-fd5a-435f-adbc-5069d606aedf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:16.884241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-731623ab-fd5a-435f-adbc-5069d606aedf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:16.884702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-731623ab-fd5a-435f-adbc-5069d606aedf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:17.013936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-731623ab-fd5a-435f-adbc-5069d606aedf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:17.021855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-731623ab-fd5a-435f-adbc-5069d606aedf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149782 Jun 20 06:41:17.022413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 907/1885] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:16 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:17.552117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:41:17.552717 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:41:18.039604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-03ee083c-5f06-47af-81a9-2446cbec11f6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:18.040134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-03ee083c-5f06-47af-81a9-2446cbec11f6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:18.047331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03ee083c-5f06-47af-81a9-2446cbec11f6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:18.047779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03ee083c-5f06-47af-81a9-2446cbec11f6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:18.048539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03ee083c-5f06-47af-81a9-2446cbec11f6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:18.048973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03ee083c-5f06-47af-81a9-2446cbec11f6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:18.177334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-03ee083c-5f06-47af-81a9-2446cbec11f6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:18.186354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-03ee083c-5f06-47af-81a9-2446cbec11f6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150720 Jun 20 06:41:18.186923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 979/1886] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:18 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:19.203827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3847c107-e386-460f-af1c-f813b1a80439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:19.204439 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3847c107-e386-460f-af1c-f813b1a80439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:19.210901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3847c107-e386-460f-af1c-f813b1a80439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:19.211350 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3847c107-e386-460f-af1c-f813b1a80439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:19.212110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3847c107-e386-460f-af1c-f813b1a80439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:19.212542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3847c107-e386-460f-af1c-f813b1a80439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:19.338862 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3847c107-e386-460f-af1c-f813b1a80439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:19.346783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3847c107-e386-460f-af1c-f813b1a80439 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146817 Jun 20 06:41:19.347345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 908/1887] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:19 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:19.788453 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:41:19.788685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:41:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:41:20.363900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-06166379-7d34-46aa-b99d-300b9e17d103 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:20.364541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-06166379-7d34-46aa-b99d-300b9e17d103 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:20.371047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06166379-7d34-46aa-b99d-300b9e17d103 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:20.371486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06166379-7d34-46aa-b99d-300b9e17d103 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:20.372229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06166379-7d34-46aa-b99d-300b9e17d103 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:20.372658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-06166379-7d34-46aa-b99d-300b9e17d103 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:20.501670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-06166379-7d34-46aa-b99d-300b9e17d103 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:20.510205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-06166379-7d34-46aa-b99d-300b9e17d103 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149390 Jun 20 06:41:20.510791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 980/1888] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:20 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:21.527908 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3f8ca647-7948-4db6-b75d-38d1ad28c0c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:21.528518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3f8ca647-7948-4db6-b75d-38d1ad28c0c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:21.535155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f8ca647-7948-4db6-b75d-38d1ad28c0c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:21.535606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f8ca647-7948-4db6-b75d-38d1ad28c0c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:21.536379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f8ca647-7948-4db6-b75d-38d1ad28c0c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:21.536799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3f8ca647-7948-4db6-b75d-38d1ad28c0c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:21.664089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3f8ca647-7948-4db6-b75d-38d1ad28c0c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:21.672070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3f8ca647-7948-4db6-b75d-38d1ad28c0c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148602 Jun 20 06:41:21.672640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 909/1889] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:21 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:22.688476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc7f71e8-9b69-45c6-9835-be04853b5666 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:22.689087 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc7f71e8-9b69-45c6-9835-be04853b5666 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:22.695570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc7f71e8-9b69-45c6-9835-be04853b5666 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:22.696016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc7f71e8-9b69-45c6-9835-be04853b5666 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:22.696768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc7f71e8-9b69-45c6-9835-be04853b5666 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:22.697243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc7f71e8-9b69-45c6-9835-be04853b5666 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:22.827548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc7f71e8-9b69-45c6-9835-be04853b5666 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:22.835473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc7f71e8-9b69-45c6-9835-be04853b5666 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150877 Jun 20 06:41:22.836024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 981/1890] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:22 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:23.852950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0d4c8a0-f967-45fe-8eef-99e6cc6008f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:23.854386 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a0d4c8a0-f967-45fe-8eef-99e6cc6008f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:23.860511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0d4c8a0-f967-45fe-8eef-99e6cc6008f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:23.860960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0d4c8a0-f967-45fe-8eef-99e6cc6008f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:23.861745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0d4c8a0-f967-45fe-8eef-99e6cc6008f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:23.862181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0d4c8a0-f967-45fe-8eef-99e6cc6008f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:23.987735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0d4c8a0-f967-45fe-8eef-99e6cc6008f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:23.995852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a0d4c8a0-f967-45fe-8eef-99e6cc6008f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146710 Jun 20 06:41:23.996412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 910/1891] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:23 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:25.014114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d7754288-5e90-4218-beac-3300b13b9cfb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:25.014728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d7754288-5e90-4218-beac-3300b13b9cfb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:25.021228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7754288-5e90-4218-beac-3300b13b9cfb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:25.021709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7754288-5e90-4218-beac-3300b13b9cfb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:25.022499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7754288-5e90-4218-beac-3300b13b9cfb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:25.022932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7754288-5e90-4218-beac-3300b13b9cfb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:25.149716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7754288-5e90-4218-beac-3300b13b9cfb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:25.158075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d7754288-5e90-4218-beac-3300b13b9cfb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148340 Jun 20 06:41:25.158637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 982/1892] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:25 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:26.175541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b75e471c-69c3-4edb-91ff-7f5d19351cc1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:26.176178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b75e471c-69c3-4edb-91ff-7f5d19351cc1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:26.182804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b75e471c-69c3-4edb-91ff-7f5d19351cc1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:26.183256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b75e471c-69c3-4edb-91ff-7f5d19351cc1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:26.184018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b75e471c-69c3-4edb-91ff-7f5d19351cc1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:26.184452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b75e471c-69c3-4edb-91ff-7f5d19351cc1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:26.313883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b75e471c-69c3-4edb-91ff-7f5d19351cc1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:26.322348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b75e471c-69c3-4edb-91ff-7f5d19351cc1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150083 Jun 20 06:41:26.322951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 911/1893] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:26 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:27.340551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-30b75c22-b216-49b9-b00a-e08f637169fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:27.341158 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-30b75c22-b216-49b9-b00a-e08f637169fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:27.347630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-30b75c22-b216-49b9-b00a-e08f637169fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:27.348074 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-30b75c22-b216-49b9-b00a-e08f637169fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:27.348828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-30b75c22-b216-49b9-b00a-e08f637169fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:27.349251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-30b75c22-b216-49b9-b00a-e08f637169fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:27.474954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-30b75c22-b216-49b9-b00a-e08f637169fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:27.484063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-30b75c22-b216-49b9-b00a-e08f637169fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147963 Jun 20 06:41:27.484624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 983/1894] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:27 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:28.500907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fb284aac-7b23-4ece-9bd0-99aaea84e88b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:28.501556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fb284aac-7b23-4ece-9bd0-99aaea84e88b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:28.508001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb284aac-7b23-4ece-9bd0-99aaea84e88b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:28.508445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb284aac-7b23-4ece-9bd0-99aaea84e88b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:28.509226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb284aac-7b23-4ece-9bd0-99aaea84e88b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:28.509693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fb284aac-7b23-4ece-9bd0-99aaea84e88b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:28.646290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fb284aac-7b23-4ece-9bd0-99aaea84e88b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:28.654121 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fb284aac-7b23-4ece-9bd0-99aaea84e88b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.157106 Jun 20 06:41:28.654676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 912/1895] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:28 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:41:29.671890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58f8b3f0-cadc-489f-9d5c-70114491b417 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:29.672518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-58f8b3f0-cadc-489f-9d5c-70114491b417 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:29.678942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58f8b3f0-cadc-489f-9d5c-70114491b417 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:29.679376 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58f8b3f0-cadc-489f-9d5c-70114491b417 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:29.680126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58f8b3f0-cadc-489f-9d5c-70114491b417 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:29.680550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58f8b3f0-cadc-489f-9d5c-70114491b417 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:29.806335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-58f8b3f0-cadc-489f-9d5c-70114491b417 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:29.814115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-58f8b3f0-cadc-489f-9d5c-70114491b417 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146103 Jun 20 06:41:29.814669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 984/1896] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:29 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:41:30.831758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3b94f77b-d6e9-4330-b98a-da3efd3bc88e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:30.832377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3b94f77b-d6e9-4330-b98a-da3efd3bc88e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:30.839012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b94f77b-d6e9-4330-b98a-da3efd3bc88e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:30.839457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b94f77b-d6e9-4330-b98a-da3efd3bc88e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:30.840213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b94f77b-d6e9-4330-b98a-da3efd3bc88e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:30.840645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b94f77b-d6e9-4330-b98a-da3efd3bc88e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:30.970111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b94f77b-d6e9-4330-b98a-da3efd3bc88e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:30.977869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3b94f77b-d6e9-4330-b98a-da3efd3bc88e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149998 Jun 20 06:41:30.979064 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 913/1897] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:30 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:31.996636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6a7c5d93-9441-45d9-903e-0f2007ccb30c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:31.997251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6a7c5d93-9441-45d9-903e-0f2007ccb30c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:32.003951 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a7c5d93-9441-45d9-903e-0f2007ccb30c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:32.004409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a7c5d93-9441-45d9-903e-0f2007ccb30c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:32.005214 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a7c5d93-9441-45d9-903e-0f2007ccb30c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:32.005695 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a7c5d93-9441-45d9-903e-0f2007ccb30c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:32.152096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6a7c5d93-9441-45d9-903e-0f2007ccb30c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:32.162212 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6a7c5d93-9441-45d9-903e-0f2007ccb30c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.170518 Jun 20 06:41:32.162708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 985/1898] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:31 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:33.179309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3daa1712-e573-45c1-b9a3-75c85a5c9c09 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:33.179927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3daa1712-e573-45c1-b9a3-75c85a5c9c09 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:33.186783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3daa1712-e573-45c1-b9a3-75c85a5c9c09 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:33.187233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3daa1712-e573-45c1-b9a3-75c85a5c9c09 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:33.187996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3daa1712-e573-45c1-b9a3-75c85a5c9c09 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:33.188437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3daa1712-e573-45c1-b9a3-75c85a5c9c09 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:33.315289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3daa1712-e573-45c1-b9a3-75c85a5c9c09 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:33.326395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3daa1712-e573-45c1-b9a3-75c85a5c9c09 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150797 Jun 20 06:41:33.327123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 914/1899] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:33 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:34.343580 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a1807cf7-a428-49e5-9938-fae3036cdb2c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:34.344184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a1807cf7-a428-49e5-9938-fae3036cdb2c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:34.350320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1807cf7-a428-49e5-9938-fae3036cdb2c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:34.350759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1807cf7-a428-49e5-9938-fae3036cdb2c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:34.351502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1807cf7-a428-49e5-9938-fae3036cdb2c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:34.351927 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1807cf7-a428-49e5-9938-fae3036cdb2c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:34.483573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a1807cf7-a428-49e5-9938-fae3036cdb2c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:34.491353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a1807cf7-a428-49e5-9938-fae3036cdb2c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151650 Jun 20 06:41:34.491903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 986/1900] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:34 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:35.508960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-68416b2f-cf31-4473-bb2f-833b04c24a35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:35.510428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-68416b2f-cf31-4473-bb2f-833b04c24a35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:35.517139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68416b2f-cf31-4473-bb2f-833b04c24a35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:35.517619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68416b2f-cf31-4473-bb2f-833b04c24a35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:35.518374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68416b2f-cf31-4473-bb2f-833b04c24a35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:35.518833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-68416b2f-cf31-4473-bb2f-833b04c24a35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:35.645338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-68416b2f-cf31-4473-bb2f-833b04c24a35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:35.653514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-68416b2f-cf31-4473-bb2f-833b04c24a35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148425 Jun 20 06:41:35.654116 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 915/1901] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:35 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:36.670351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2ad205e3-7da1-4942-9fd9-72bf9f374fa2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:36.670970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2ad205e3-7da1-4942-9fd9-72bf9f374fa2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:36.677498 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ad205e3-7da1-4942-9fd9-72bf9f374fa2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:36.677948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ad205e3-7da1-4942-9fd9-72bf9f374fa2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:36.678712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ad205e3-7da1-4942-9fd9-72bf9f374fa2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:36.679147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ad205e3-7da1-4942-9fd9-72bf9f374fa2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:36.807938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2ad205e3-7da1-4942-9fd9-72bf9f374fa2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:36.815745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2ad205e3-7da1-4942-9fd9-72bf9f374fa2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149216 Jun 20 06:41:36.816306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 987/1902] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:36 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:37.833425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bf95bc58-6dec-43a3-b0af-a2a512fe1e75 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:37.834034 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bf95bc58-6dec-43a3-b0af-a2a512fe1e75 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:37.841090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf95bc58-6dec-43a3-b0af-a2a512fe1e75 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:37.841568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf95bc58-6dec-43a3-b0af-a2a512fe1e75 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:37.842326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf95bc58-6dec-43a3-b0af-a2a512fe1e75 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:37.842754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf95bc58-6dec-43a3-b0af-a2a512fe1e75 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:37.973700 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bf95bc58-6dec-43a3-b0af-a2a512fe1e75 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:37.982192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bf95bc58-6dec-43a3-b0af-a2a512fe1e75 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152676 Jun 20 06:41:37.982938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 916/1903] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:37 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:38.999954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2f155327-c005-42ea-a4d6-6b9ca7ece129 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:39.000639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2f155327-c005-42ea-a4d6-6b9ca7ece129 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:39.007350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f155327-c005-42ea-a4d6-6b9ca7ece129 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:39.007799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f155327-c005-42ea-a4d6-6b9ca7ece129 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:39.008547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f155327-c005-42ea-a4d6-6b9ca7ece129 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:39.009099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f155327-c005-42ea-a4d6-6b9ca7ece129 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:39.146754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2f155327-c005-42ea-a4d6-6b9ca7ece129 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:39.155133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2f155327-c005-42ea-a4d6-6b9ca7ece129 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.159334 Jun 20 06:41:39.155683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 988/1904] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:38 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:40.173108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd46ce14-7aa5-48d0-90b9-c91f02ef4b0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:40.173786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd46ce14-7aa5-48d0-90b9-c91f02ef4b0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:40.180235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd46ce14-7aa5-48d0-90b9-c91f02ef4b0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:40.180694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd46ce14-7aa5-48d0-90b9-c91f02ef4b0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:40.181574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd46ce14-7aa5-48d0-90b9-c91f02ef4b0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:40.182041 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd46ce14-7aa5-48d0-90b9-c91f02ef4b0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:40.313499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd46ce14-7aa5-48d0-90b9-c91f02ef4b0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:40.321503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd46ce14-7aa5-48d0-90b9-c91f02ef4b0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152246 Jun 20 06:41:40.322630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 917/1905] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:40 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:40.533683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:41:40.533873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:41:41.339727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e7c95bbb-657f-49ff-86b0-8d33bc46b6aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:41.340335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e7c95bbb-657f-49ff-86b0-8d33bc46b6aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:41.346742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7c95bbb-657f-49ff-86b0-8d33bc46b6aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:41.347207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7c95bbb-657f-49ff-86b0-8d33bc46b6aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:41.347954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7c95bbb-657f-49ff-86b0-8d33bc46b6aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:41.348389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7c95bbb-657f-49ff-86b0-8d33bc46b6aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:41.474768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e7c95bbb-657f-49ff-86b0-8d33bc46b6aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:41.482799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e7c95bbb-657f-49ff-86b0-8d33bc46b6aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147504 Jun 20 06:41:41.483351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 989/1906] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:41 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:42.499870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bfb17b6b-92b9-45ff-9fed-e9aefac3b168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:42.500506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bfb17b6b-92b9-45ff-9fed-e9aefac3b168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:42.502855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:41:42.508483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bfb17b6b-92b9-45ff-9fed-e9aefac3b168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:42.508949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bfb17b6b-92b9-45ff-9fed-e9aefac3b168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:42.509889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bfb17b6b-92b9-45ff-9fed-e9aefac3b168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:42.510266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bfb17b6b-92b9-45ff-9fed-e9aefac3b168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:42.513029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:41:42.642568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bfb17b6b-92b9-45ff-9fed-e9aefac3b168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:42.652276 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bfb17b6b-92b9-45ff-9fed-e9aefac3b168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.156305 Jun 20 06:41:42.652837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 918/1907] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:42 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:43.670492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f4a8a807-dcc6-4056-8753-86560a151b7f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:43.671098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f4a8a807-dcc6-4056-8753-86560a151b7f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:43.673477 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:41:43.678850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4a8a807-dcc6-4056-8753-86560a151b7f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:43.679294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4a8a807-dcc6-4056-8753-86560a151b7f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:43.680047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4a8a807-dcc6-4056-8753-86560a151b7f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:43.680476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4a8a807-dcc6-4056-8753-86560a151b7f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:43.684612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=78 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:41:43.807028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f4a8a807-dcc6-4056-8753-86560a151b7f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:43.815503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f4a8a807-dcc6-4056-8753-86560a151b7f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149479 Jun 20 06:41:43.816057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 990/1908] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:43 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:44.832852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c38a03c-316c-4ddb-99b8-42da7b3e3fc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:44.833499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c38a03c-316c-4ddb-99b8-42da7b3e3fc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:44.840426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c38a03c-316c-4ddb-99b8-42da7b3e3fc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:44.840882 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c38a03c-316c-4ddb-99b8-42da7b3e3fc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:44.841682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c38a03c-316c-4ddb-99b8-42da7b3e3fc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:44.842122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c38a03c-316c-4ddb-99b8-42da7b3e3fc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:44.977527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c38a03c-316c-4ddb-99b8-42da7b3e3fc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:44.985964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c38a03c-316c-4ddb-99b8-42da7b3e3fc2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.157003 Jun 20 06:41:44.986518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 919/1909] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:44 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:46.003715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-943025c3-d04f-472b-820d-826e50c6bbda tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:46.004302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-943025c3-d04f-472b-820d-826e50c6bbda tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:46.011423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-943025c3-d04f-472b-820d-826e50c6bbda tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:46.011861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-943025c3-d04f-472b-820d-826e50c6bbda tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:46.012611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-943025c3-d04f-472b-820d-826e50c6bbda tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:46.013038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-943025c3-d04f-472b-820d-826e50c6bbda tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:46.138584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-943025c3-d04f-472b-820d-826e50c6bbda tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:46.146984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-943025c3-d04f-472b-820d-826e50c6bbda tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147181 Jun 20 06:41:46.147540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 991/1910] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:45 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:47.163422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-53390a2b-c17c-4ba9-a482-f9d0353ba351 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:47.164027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-53390a2b-c17c-4ba9-a482-f9d0353ba351 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:47.170936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-53390a2b-c17c-4ba9-a482-f9d0353ba351 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:47.171380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-53390a2b-c17c-4ba9-a482-f9d0353ba351 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:47.172135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-53390a2b-c17c-4ba9-a482-f9d0353ba351 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:47.172563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-53390a2b-c17c-4ba9-a482-f9d0353ba351 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:47.299922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-53390a2b-c17c-4ba9-a482-f9d0353ba351 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:47.309521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-53390a2b-c17c-4ba9-a482-f9d0353ba351 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149832 Jun 20 06:41:47.310374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 920/1911] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:47 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:48.328994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f8d5e155-5238-4179-92ee-a449d06c8810 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:48.329768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f8d5e155-5238-4179-92ee-a449d06c8810 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:48.336053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8d5e155-5238-4179-92ee-a449d06c8810 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:48.336495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8d5e155-5238-4179-92ee-a449d06c8810 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:48.337249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8d5e155-5238-4179-92ee-a449d06c8810 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:48.337702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8d5e155-5238-4179-92ee-a449d06c8810 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:48.477238 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f8d5e155-5238-4179-92ee-a449d06c8810 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:48.485987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f8d5e155-5238-4179-92ee-a449d06c8810 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.160848 Jun 20 06:41:48.486550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 992/1912] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:48 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:49.502516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d9a911be-5a5d-4a33-84b9-63f39fc5cc83 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:49.503156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d9a911be-5a5d-4a33-84b9-63f39fc5cc83 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:49.509688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9a911be-5a5d-4a33-84b9-63f39fc5cc83 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:49.510668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9a911be-5a5d-4a33-84b9-63f39fc5cc83 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:49.511490 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9a911be-5a5d-4a33-84b9-63f39fc5cc83 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:49.511927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9a911be-5a5d-4a33-84b9-63f39fc5cc83 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:49.641133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d9a911be-5a5d-4a33-84b9-63f39fc5cc83 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:49.648960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d9a911be-5a5d-4a33-84b9-63f39fc5cc83 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150349 Jun 20 06:41:49.649574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 921/1913] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:49 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:50.665450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-909c1167-c952-4f89-8c9b-e52b36a2dcaf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:50.666061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-909c1167-c952-4f89-8c9b-e52b36a2dcaf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:50.673268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-909c1167-c952-4f89-8c9b-e52b36a2dcaf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:50.673736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-909c1167-c952-4f89-8c9b-e52b36a2dcaf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:50.674482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-909c1167-c952-4f89-8c9b-e52b36a2dcaf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:50.674907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-909c1167-c952-4f89-8c9b-e52b36a2dcaf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:50.804843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-909c1167-c952-4f89-8c9b-e52b36a2dcaf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:50.813060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-909c1167-c952-4f89-8c9b-e52b36a2dcaf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151417 Jun 20 06:41:50.813647 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 993/1914] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:50 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:51.830236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1e98ac5a-6fb5-437c-8aea-22ec95f6a2ab tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:51.830892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1e98ac5a-6fb5-437c-8aea-22ec95f6a2ab tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:51.837361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e98ac5a-6fb5-437c-8aea-22ec95f6a2ab tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:51.837946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e98ac5a-6fb5-437c-8aea-22ec95f6a2ab tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:51.838914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e98ac5a-6fb5-437c-8aea-22ec95f6a2ab tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:51.839354 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e98ac5a-6fb5-437c-8aea-22ec95f6a2ab tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:51.966893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1e98ac5a-6fb5-437c-8aea-22ec95f6a2ab tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:51.974816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1e98ac5a-6fb5-437c-8aea-22ec95f6a2ab tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148492 Jun 20 06:41:51.975373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 922/1915] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:51 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:52.992208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f0839574-57dc-429e-ac99-8724242c18bf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:52.992815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f0839574-57dc-429e-ac99-8724242c18bf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:52.999853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0839574-57dc-429e-ac99-8724242c18bf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:53.000293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0839574-57dc-429e-ac99-8724242c18bf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:53.001041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0839574-57dc-429e-ac99-8724242c18bf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:53.001497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0839574-57dc-429e-ac99-8724242c18bf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:53.134688 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f0839574-57dc-429e-ac99-8724242c18bf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:53.143447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f0839574-57dc-429e-ac99-8724242c18bf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.155017 Jun 20 06:41:53.144011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 994/1916] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:52 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:54.160395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bdf2c21d-fd67-4089-be81-c79c6bc7d0b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:54.160993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bdf2c21d-fd67-4089-be81-c79c6bc7d0b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:54.168091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bdf2c21d-fd67-4089-be81-c79c6bc7d0b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:54.168539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bdf2c21d-fd67-4089-be81-c79c6bc7d0b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:54.169295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bdf2c21d-fd67-4089-be81-c79c6bc7d0b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:54.169754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bdf2c21d-fd67-4089-be81-c79c6bc7d0b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:54.296313 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bdf2c21d-fd67-4089-be81-c79c6bc7d0b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:54.304317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bdf2c21d-fd67-4089-be81-c79c6bc7d0b3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147809 Jun 20 06:41:54.304871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 923/1917] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:54 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:55.321091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-39faad53-bad4-4081-aaca-b4dd09d8da5a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:55.321726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-39faad53-bad4-4081-aaca-b4dd09d8da5a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:55.329545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39faad53-bad4-4081-aaca-b4dd09d8da5a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:55.329990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39faad53-bad4-4081-aaca-b4dd09d8da5a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:55.330757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39faad53-bad4-4081-aaca-b4dd09d8da5a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:55.331187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39faad53-bad4-4081-aaca-b4dd09d8da5a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:55.459189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-39faad53-bad4-4081-aaca-b4dd09d8da5a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:55.467056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-39faad53-bad4-4081-aaca-b4dd09d8da5a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149778 Jun 20 06:41:55.467609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 995/1918] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:55 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:56.485765 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6918baae-ad84-4247-8dbf-a0b6a283a240 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:56.486377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6918baae-ad84-4247-8dbf-a0b6a283a240 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:56.492956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6918baae-ad84-4247-8dbf-a0b6a283a240 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:56.493432 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6918baae-ad84-4247-8dbf-a0b6a283a240 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:56.494879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6918baae-ad84-4247-8dbf-a0b6a283a240 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:56.495142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6918baae-ad84-4247-8dbf-a0b6a283a240 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:56.626218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6918baae-ad84-4247-8dbf-a0b6a283a240 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:56.634196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6918baae-ad84-4247-8dbf-a0b6a283a240 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152265 Jun 20 06:41:56.634755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 924/1919] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:56 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:57.652485 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5107db7a-2bba-4703-a518-27611d352c7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:57.653103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5107db7a-2bba-4703-a518-27611d352c7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:57.659622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5107db7a-2bba-4703-a518-27611d352c7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:57.660070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5107db7a-2bba-4703-a518-27611d352c7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:57.660827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5107db7a-2bba-4703-a518-27611d352c7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:57.661260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5107db7a-2bba-4703-a518-27611d352c7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:57.792725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5107db7a-2bba-4703-a518-27611d352c7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:57.800616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5107db7a-2bba-4703-a518-27611d352c7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152642 Jun 20 06:41:57.801173 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 996/1920] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:57 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:58.818017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0a086302-73e2-49b4-9b60-45abe8c5287e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:58.818638 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0a086302-73e2-49b4-9b60-45abe8c5287e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:58.825109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a086302-73e2-49b4-9b60-45abe8c5287e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:58.825594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a086302-73e2-49b4-9b60-45abe8c5287e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:58.826359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a086302-73e2-49b4-9b60-45abe8c5287e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:58.826799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0a086302-73e2-49b4-9b60-45abe8c5287e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:58.958119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0a086302-73e2-49b4-9b60-45abe8c5287e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:41:58.966569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0a086302-73e2-49b4-9b60-45abe8c5287e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152378 Jun 20 06:41:58.967123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 925/1921] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:58 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:41:59.983732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a3cbfd2-cfd7-4fbe-969f-1d450537ad4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:41:59.984401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2a3cbfd2-cfd7-4fbe-969f-1d450537ad4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:41:59.990743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a3cbfd2-cfd7-4fbe-969f-1d450537ad4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:59.991184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a3cbfd2-cfd7-4fbe-969f-1d450537ad4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:41:59.991935 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a3cbfd2-cfd7-4fbe-969f-1d450537ad4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:41:59.992363 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a3cbfd2-cfd7-4fbe-969f-1d450537ad4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:00.119400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2a3cbfd2-cfd7-4fbe-969f-1d450537ad4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:00.127359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2a3cbfd2-cfd7-4fbe-969f-1d450537ad4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147990 Jun 20 06:42:00.127925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 997/1922] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:41:59 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:01.144788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d806431-a40f-4553-ae08-d9121f244fa6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:01.145331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d806431-a40f-4553-ae08-d9121f244fa6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:01.151898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d806431-a40f-4553-ae08-d9121f244fa6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:01.152368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d806431-a40f-4553-ae08-d9121f244fa6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:01.153120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d806431-a40f-4553-ae08-d9121f244fa6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:01.153583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3d806431-a40f-4553-ae08-d9121f244fa6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:01.279792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d806431-a40f-4553-ae08-d9121f244fa6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:01.287795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d806431-a40f-4553-ae08-d9121f244fa6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146930 Jun 20 06:42:01.288346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 926/1923] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:01 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:02.305919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fe4105c2-fcd7-477f-91d0-f29dedb0c7cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:02.306522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fe4105c2-fcd7-477f-91d0-f29dedb0c7cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:02.313741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe4105c2-fcd7-477f-91d0-f29dedb0c7cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:02.314191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe4105c2-fcd7-477f-91d0-f29dedb0c7cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:02.314956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe4105c2-fcd7-477f-91d0-f29dedb0c7cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:02.315391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fe4105c2-fcd7-477f-91d0-f29dedb0c7cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:02.447097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fe4105c2-fcd7-477f-91d0-f29dedb0c7cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:02.455055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fe4105c2-fcd7-477f-91d0-f29dedb0c7cf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152990 Jun 20 06:42:02.455616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 998/1924] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:02 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:03.471958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dae3bd14-ec56-4120-93dd-bb418aaf8792 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:03.472569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dae3bd14-ec56-4120-93dd-bb418aaf8792 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:03.479129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dae3bd14-ec56-4120-93dd-bb418aaf8792 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:03.479577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dae3bd14-ec56-4120-93dd-bb418aaf8792 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:03.481094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dae3bd14-ec56-4120-93dd-bb418aaf8792 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:03.481560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dae3bd14-ec56-4120-93dd-bb418aaf8792 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:03.609897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dae3bd14-ec56-4120-93dd-bb418aaf8792 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:03.617979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dae3bd14-ec56-4120-93dd-bb418aaf8792 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149847 Jun 20 06:42:03.618573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 927/1925] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:03 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:04.635486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d4c154d8-a5ee-45c3-b914-44ff835c639a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:04.636679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d4c154d8-a5ee-45c3-b914-44ff835c639a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:04.643022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d4c154d8-a5ee-45c3-b914-44ff835c639a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:04.643463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d4c154d8-a5ee-45c3-b914-44ff835c639a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:04.644209 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d4c154d8-a5ee-45c3-b914-44ff835c639a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:04.644638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d4c154d8-a5ee-45c3-b914-44ff835c639a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:04.773367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d4c154d8-a5ee-45c3-b914-44ff835c639a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:04.781622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d4c154d8-a5ee-45c3-b914-44ff835c639a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149906 Jun 20 06:42:04.782207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 999/1926] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:04 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:05.800209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40e8569c-6ce3-4560-8870-41541747b0f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:05.800830 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40e8569c-6ce3-4560-8870-41541747b0f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:05.809592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40e8569c-6ce3-4560-8870-41541747b0f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:05.810065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40e8569c-6ce3-4560-8870-41541747b0f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:05.810844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40e8569c-6ce3-4560-8870-41541747b0f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:05.811284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40e8569c-6ce3-4560-8870-41541747b0f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:05.939302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40e8569c-6ce3-4560-8870-41541747b0f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:05.947197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40e8569c-6ce3-4560-8870-41541747b0f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152368 Jun 20 06:42:05.947770 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 928/1927] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:05 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:06.963564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-432f8802-2725-49cc-8ef3-db62f97f3672 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:06.965083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-432f8802-2725-49cc-8ef3-db62f97f3672 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:06.971378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-432f8802-2725-49cc-8ef3-db62f97f3672 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:06.971818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-432f8802-2725-49cc-8ef3-db62f97f3672 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:06.972566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-432f8802-2725-49cc-8ef3-db62f97f3672 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:06.973015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-432f8802-2725-49cc-8ef3-db62f97f3672 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:07.103123 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-432f8802-2725-49cc-8ef3-db62f97f3672 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:07.111114 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-432f8802-2725-49cc-8ef3-db62f97f3672 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151391 Jun 20 06:42:07.111667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1000/1928] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:06 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:08.131998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-778fe9d6-1cff-4a55-9efd-efb5155730a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:08.132614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-778fe9d6-1cff-4a55-9efd-efb5155730a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:08.139581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-778fe9d6-1cff-4a55-9efd-efb5155730a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:08.140036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-778fe9d6-1cff-4a55-9efd-efb5155730a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:08.140800 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-778fe9d6-1cff-4a55-9efd-efb5155730a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:08.141245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-778fe9d6-1cff-4a55-9efd-efb5155730a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:08.270240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-778fe9d6-1cff-4a55-9efd-efb5155730a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:08.278473 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-778fe9d6-1cff-4a55-9efd-efb5155730a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150326 Jun 20 06:42:08.279042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 929/1929] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:08 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:09.295751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0432c6df-49e5-48cc-87b9-f8b615648c56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:09.296317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0432c6df-49e5-48cc-87b9-f8b615648c56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:09.302744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0432c6df-49e5-48cc-87b9-f8b615648c56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:09.303195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0432c6df-49e5-48cc-87b9-f8b615648c56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:09.303959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0432c6df-49e5-48cc-87b9-f8b615648c56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:09.304395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0432c6df-49e5-48cc-87b9-f8b615648c56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:09.437689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0432c6df-49e5-48cc-87b9-f8b615648c56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:09.445437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0432c6df-49e5-48cc-87b9-f8b615648c56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.154280 Jun 20 06:42:09.445993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1001/1930] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:09 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:10.462637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c9fbf93-df55-42d2-8cb4-1d5a84f8e786 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:10.463255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c9fbf93-df55-42d2-8cb4-1d5a84f8e786 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:10.469772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c9fbf93-df55-42d2-8cb4-1d5a84f8e786 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:10.470251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c9fbf93-df55-42d2-8cb4-1d5a84f8e786 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:10.471011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c9fbf93-df55-42d2-8cb4-1d5a84f8e786 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:10.471454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c9fbf93-df55-42d2-8cb4-1d5a84f8e786 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:10.760341 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c9fbf93-df55-42d2-8cb4-1d5a84f8e786 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:10.768546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c9fbf93-df55-42d2-8cb4-1d5a84f8e786 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.309849 Jun 20 06:42:10.769107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 930/1931] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:10 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:11.785669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3e77cbc6-c97f-483d-89da-20af061a016a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:11.786199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3e77cbc6-c97f-483d-89da-20af061a016a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:11.793150 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e77cbc6-c97f-483d-89da-20af061a016a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:11.793624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e77cbc6-c97f-483d-89da-20af061a016a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:11.794380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e77cbc6-c97f-483d-89da-20af061a016a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:11.794812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e77cbc6-c97f-483d-89da-20af061a016a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:11.971731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3e77cbc6-c97f-483d-89da-20af061a016a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:11.980039 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3e77cbc6-c97f-483d-89da-20af061a016a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.197887 Jun 20 06:42:11.980600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1002/1932] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:11 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:12.996719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1ebb6e56-0ee3-4081-9c93-f6c8c055a28a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:12.997332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1ebb6e56-0ee3-4081-9c93-f6c8c055a28a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:12.999658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:13.004923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1ebb6e56-0ee3-4081-9c93-f6c8c055a28a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:13.005368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1ebb6e56-0ee3-4081-9c93-f6c8c055a28a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:13.006153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1ebb6e56-0ee3-4081-9c93-f6c8c055a28a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:13.006588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1ebb6e56-0ee3-4081-9c93-f6c8c055a28a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:13.010611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:13.139580 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1ebb6e56-0ee3-4081-9c93-f6c8c055a28a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:13.147295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1ebb6e56-0ee3-4081-9c93-f6c8c055a28a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.154502 Jun 20 06:42:13.147852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 931/1933] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:12 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:14.163732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-595e51bc-68c6-4ecf-af3c-b3bab7d27300 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:14.164331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-595e51bc-68c6-4ecf-af3c-b3bab7d27300 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:14.166596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:14.172054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-595e51bc-68c6-4ecf-af3c-b3bab7d27300 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:14.172496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-595e51bc-68c6-4ecf-af3c-b3bab7d27300 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:14.173241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-595e51bc-68c6-4ecf-af3c-b3bab7d27300 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:14.173694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-595e51bc-68c6-4ecf-af3c-b3bab7d27300 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:14.176303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=78 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:14.299222 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-595e51bc-68c6-4ecf-af3c-b3bab7d27300 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:14.307126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-595e51bc-68c6-4ecf-af3c-b3bab7d27300 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147190 Jun 20 06:42:14.307700 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1003/1934] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:14 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:15.324267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-52800fd7-994e-4f46-9ba6-e673c0d7f9ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:15.324820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-52800fd7-994e-4f46-9ba6-e673c0d7f9ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:15.331670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52800fd7-994e-4f46-9ba6-e673c0d7f9ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:15.332121 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52800fd7-994e-4f46-9ba6-e673c0d7f9ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:15.332898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52800fd7-994e-4f46-9ba6-e673c0d7f9ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:15.333336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-52800fd7-994e-4f46-9ba6-e673c0d7f9ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:15.461266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-52800fd7-994e-4f46-9ba6-e673c0d7f9ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:15.470582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-52800fd7-994e-4f46-9ba6-e673c0d7f9ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150398 Jun 20 06:42:15.471153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 932/1935] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:15 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:16.487259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4a5b6300-9c28-4559-a94d-ce2c323edc53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:16.487880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4a5b6300-9c28-4559-a94d-ce2c323edc53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:16.494369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a5b6300-9c28-4559-a94d-ce2c323edc53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:16.494824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a5b6300-9c28-4559-a94d-ce2c323edc53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:16.495813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a5b6300-9c28-4559-a94d-ce2c323edc53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:16.496255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a5b6300-9c28-4559-a94d-ce2c323edc53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:16.626254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a5b6300-9c28-4559-a94d-ce2c323edc53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:16.634208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4a5b6300-9c28-4559-a94d-ce2c323edc53 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150784 Jun 20 06:42:16.634778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1004/1936] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:16 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:17.651533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e9b5786e-af57-4176-bd4d-6d43cccfca88 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:17.652145 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9b5786e-af57-4176-bd4d-6d43cccfca88 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:17.658638 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9b5786e-af57-4176-bd4d-6d43cccfca88 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:17.659090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9b5786e-af57-4176-bd4d-6d43cccfca88 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:17.659855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9b5786e-af57-4176-bd4d-6d43cccfca88 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:17.660295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9b5786e-af57-4176-bd4d-6d43cccfca88 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:17.788038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e9b5786e-af57-4176-bd4d-6d43cccfca88 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:17.795915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e9b5786e-af57-4176-bd4d-6d43cccfca88 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148307 Jun 20 06:42:17.796488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 933/1937] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:17 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:18.813822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c66c3123-80c3-40b4-adb2-cc5f2a52ef82 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:18.814434 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c66c3123-80c3-40b4-adb2-cc5f2a52ef82 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:18.821045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c66c3123-80c3-40b4-adb2-cc5f2a52ef82 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:18.821526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c66c3123-80c3-40b4-adb2-cc5f2a52ef82 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:18.822286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c66c3123-80c3-40b4-adb2-cc5f2a52ef82 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:18.822720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c66c3123-80c3-40b4-adb2-cc5f2a52ef82 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:18.955910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c66c3123-80c3-40b4-adb2-cc5f2a52ef82 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:18.964712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c66c3123-80c3-40b4-adb2-cc5f2a52ef82 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153758 Jun 20 06:42:18.965512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1005/1938] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:18 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:19.982393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f81214b-09f0-4aed-9bc0-0714f8113223 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:19.982995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f81214b-09f0-4aed-9bc0-0714f8113223 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:19.989836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f81214b-09f0-4aed-9bc0-0714f8113223 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:19.990281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f81214b-09f0-4aed-9bc0-0714f8113223 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:19.991032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f81214b-09f0-4aed-9bc0-0714f8113223 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:19.991461 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f81214b-09f0-4aed-9bc0-0714f8113223 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:20.118029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f81214b-09f0-4aed-9bc0-0714f8113223 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:20.126509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f81214b-09f0-4aed-9bc0-0714f8113223 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148414 Jun 20 06:42:20.127194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 934/1939] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:19 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:42:21.143789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6cc1564f-8608-48df-b4a5-2255564affb6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:21.144317 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6cc1564f-8608-48df-b4a5-2255564affb6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:21.150748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6cc1564f-8608-48df-b4a5-2255564affb6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:21.151264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6cc1564f-8608-48df-b4a5-2255564affb6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:21.152022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6cc1564f-8608-48df-b4a5-2255564affb6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:21.152456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6cc1564f-8608-48df-b4a5-2255564affb6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:21.280532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6cc1564f-8608-48df-b4a5-2255564affb6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:21.288418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6cc1564f-8608-48df-b4a5-2255564affb6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148572 Jun 20 06:42:21.288980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1006/1940] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:21 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:22.305408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d6b23ff-f4c9-43e5-a8d5-d3298d56f5b9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:22.306774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d6b23ff-f4c9-43e5-a8d5-d3298d56f5b9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:22.314271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d6b23ff-f4c9-43e5-a8d5-d3298d56f5b9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:22.314726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d6b23ff-f4c9-43e5-a8d5-d3298d56f5b9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:22.315498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d6b23ff-f4c9-43e5-a8d5-d3298d56f5b9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:22.315934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d6b23ff-f4c9-43e5-a8d5-d3298d56f5b9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:22.446103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d6b23ff-f4c9-43e5-a8d5-d3298d56f5b9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:22.454420 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d6b23ff-f4c9-43e5-a8d5-d3298d56f5b9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152865 Jun 20 06:42:22.454980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 935/1941] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:22 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:23.471971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3ed1018b-95c7-406b-93c2-0cd24058eb8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:23.472589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3ed1018b-95c7-406b-93c2-0cd24058eb8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:23.479207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ed1018b-95c7-406b-93c2-0cd24058eb8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:23.479936 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ed1018b-95c7-406b-93c2-0cd24058eb8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:23.480701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ed1018b-95c7-406b-93c2-0cd24058eb8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:23.481141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ed1018b-95c7-406b-93c2-0cd24058eb8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:23.611240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3ed1018b-95c7-406b-93c2-0cd24058eb8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:23.619182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3ed1018b-95c7-406b-93c2-0cd24058eb8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151082 Jun 20 06:42:23.620296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1007/1942] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:23 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:24.636602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f274832-1a79-4471-9ee8-8562ffb3b064 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:24.637205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f274832-1a79-4471-9ee8-8562ffb3b064 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:24.643878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f274832-1a79-4471-9ee8-8562ffb3b064 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:24.644323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f274832-1a79-4471-9ee8-8562ffb3b064 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:24.645071 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f274832-1a79-4471-9ee8-8562ffb3b064 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:24.645533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f274832-1a79-4471-9ee8-8562ffb3b064 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:24.773964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f274832-1a79-4471-9ee8-8562ffb3b064 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:24.781714 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f274832-1a79-4471-9ee8-8562ffb3b064 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148955 Jun 20 06:42:24.782268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 936/1943] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:24 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:25.798125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-42644264-0080-4b0c-977a-2442939a193d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:25.798746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-42644264-0080-4b0c-977a-2442939a193d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:25.805142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42644264-0080-4b0c-977a-2442939a193d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:25.805624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42644264-0080-4b0c-977a-2442939a193d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:25.806374 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42644264-0080-4b0c-977a-2442939a193d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:25.806803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42644264-0080-4b0c-977a-2442939a193d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:25.937641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-42644264-0080-4b0c-977a-2442939a193d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:25.945461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-42644264-0080-4b0c-977a-2442939a193d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151158 Jun 20 06:42:25.946020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1008/1944] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:25 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:26.962794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-df9ffd04-0cc5-446b-8b8a-ceac8e4d8df4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:26.963595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-df9ffd04-0cc5-446b-8b8a-ceac8e4d8df4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:26.970250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df9ffd04-0cc5-446b-8b8a-ceac8e4d8df4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:26.970696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df9ffd04-0cc5-446b-8b8a-ceac8e4d8df4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:26.971451 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df9ffd04-0cc5-446b-8b8a-ceac8e4d8df4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:26.971882 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df9ffd04-0cc5-446b-8b8a-ceac8e4d8df4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:27.104749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-df9ffd04-0cc5-446b-8b8a-ceac8e4d8df4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:27.114344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-df9ffd04-0cc5-446b-8b8a-ceac8e4d8df4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.155406 Jun 20 06:42:27.114922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 937/1945] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:26 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:28.131977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e50a274d-b6ce-46a2-9c32-351fab6354aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:28.132582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e50a274d-b6ce-46a2-9c32-351fab6354aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:28.139978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e50a274d-b6ce-46a2-9c32-351fab6354aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:28.140415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e50a274d-b6ce-46a2-9c32-351fab6354aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:28.141159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e50a274d-b6ce-46a2-9c32-351fab6354aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:28.141616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e50a274d-b6ce-46a2-9c32-351fab6354aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:28.269001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e50a274d-b6ce-46a2-9c32-351fab6354aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:28.277311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e50a274d-b6ce-46a2-9c32-351fab6354aa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149186 Jun 20 06:42:28.277886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1009/1946] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:28 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:29.294281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-70a73c6e-fbb3-435e-ad5b-03f8d6363878 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:29.294824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-70a73c6e-fbb3-435e-ad5b-03f8d6363878 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:29.301200 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70a73c6e-fbb3-435e-ad5b-03f8d6363878 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:29.301673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70a73c6e-fbb3-435e-ad5b-03f8d6363878 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:29.302428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70a73c6e-fbb3-435e-ad5b-03f8d6363878 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:29.302858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-70a73c6e-fbb3-435e-ad5b-03f8d6363878 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:29.430334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-70a73c6e-fbb3-435e-ad5b-03f8d6363878 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:29.439203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-70a73c6e-fbb3-435e-ad5b-03f8d6363878 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149009 Jun 20 06:42:29.439775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 938/1947] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:29 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:30.457451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3edd6679-0e90-4099-80fa-8962181cfc15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:30.458071 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3edd6679-0e90-4099-80fa-8962181cfc15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:30.464638 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3edd6679-0e90-4099-80fa-8962181cfc15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:30.465088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3edd6679-0e90-4099-80fa-8962181cfc15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:30.465885 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3edd6679-0e90-4099-80fa-8962181cfc15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:30.466323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3edd6679-0e90-4099-80fa-8962181cfc15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:30.603629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3edd6679-0e90-4099-80fa-8962181cfc15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:30.612011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3edd6679-0e90-4099-80fa-8962181cfc15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.158530 Jun 20 06:42:30.612568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1010/1948] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:30 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:31.629725 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bbba15eb-894a-450a-b6dd-8fea9e494e42 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:31.630346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bbba15eb-894a-450a-b6dd-8fea9e494e42 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:31.637826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbba15eb-894a-450a-b6dd-8fea9e494e42 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:31.638528 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbba15eb-894a-450a-b6dd-8fea9e494e42 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:31.639300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbba15eb-894a-450a-b6dd-8fea9e494e42 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:31.639742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbba15eb-894a-450a-b6dd-8fea9e494e42 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:31.765729 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bbba15eb-894a-450a-b6dd-8fea9e494e42 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:31.773512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bbba15eb-894a-450a-b6dd-8fea9e494e42 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147614 Jun 20 06:42:31.774068 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 939/1949] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:31 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:32.790677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-23ebf52d-3721-489f-ac00-a65c63ca0e6a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:32.791306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-23ebf52d-3721-489f-ac00-a65c63ca0e6a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:32.801826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23ebf52d-3721-489f-ac00-a65c63ca0e6a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:32.802272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23ebf52d-3721-489f-ac00-a65c63ca0e6a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:32.803049 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23ebf52d-3721-489f-ac00-a65c63ca0e6a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:32.803480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23ebf52d-3721-489f-ac00-a65c63ca0e6a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:32.958056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-23ebf52d-3721-489f-ac00-a65c63ca0e6a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:32.967007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-23ebf52d-3721-489f-ac00-a65c63ca0e6a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.180227 Jun 20 06:42:32.967580 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1011/1950] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:32 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:33.985601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-83630b63-b341-4b9c-ab2d-8e6a52f5ba60 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:33.986218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-83630b63-b341-4b9c-ab2d-8e6a52f5ba60 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:33.992921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-83630b63-b341-4b9c-ab2d-8e6a52f5ba60 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:33.993246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-83630b63-b341-4b9c-ab2d-8e6a52f5ba60 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:33.994035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-83630b63-b341-4b9c-ab2d-8e6a52f5ba60 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:33.995005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-83630b63-b341-4b9c-ab2d-8e6a52f5ba60 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:34.197247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-83630b63-b341-4b9c-ab2d-8e6a52f5ba60 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:34.205880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-83630b63-b341-4b9c-ab2d-8e6a52f5ba60 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.224210 Jun 20 06:42:34.206455 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 940/1951] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:33 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:35.222302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8f6fdd49-27ea-4a68-8fb4-8593a518eb67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:35.222925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8f6fdd49-27ea-4a68-8fb4-8593a518eb67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:35.229492 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f6fdd49-27ea-4a68-8fb4-8593a518eb67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:35.229934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f6fdd49-27ea-4a68-8fb4-8593a518eb67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:35.230687 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f6fdd49-27ea-4a68-8fb4-8593a518eb67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:35.231117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8f6fdd49-27ea-4a68-8fb4-8593a518eb67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:35.362558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8f6fdd49-27ea-4a68-8fb4-8593a518eb67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:35.371125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8f6fdd49-27ea-4a68-8fb4-8593a518eb67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152646 Jun 20 06:42:35.371681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1012/1952] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:35 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:36.388340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-680a41df-f26c-439c-85f2-5c97b762e48c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:36.388948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-680a41df-f26c-439c-85f2-5c97b762e48c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:36.395347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-680a41df-f26c-439c-85f2-5c97b762e48c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:36.395791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-680a41df-f26c-439c-85f2-5c97b762e48c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:36.396545 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-680a41df-f26c-439c-85f2-5c97b762e48c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:36.396976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-680a41df-f26c-439c-85f2-5c97b762e48c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:36.523152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-680a41df-f26c-439c-85f2-5c97b762e48c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:36.531615 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-680a41df-f26c-439c-85f2-5c97b762e48c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147508 Jun 20 06:42:36.532176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 941/1953] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:36 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:37.548134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-99b4ce36-eca9-43ea-8b3a-3cece7352c1d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:37.548742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-99b4ce36-eca9-43ea-8b3a-3cece7352c1d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:37.555160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b4ce36-eca9-43ea-8b3a-3cece7352c1d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:37.555605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b4ce36-eca9-43ea-8b3a-3cece7352c1d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:37.556354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b4ce36-eca9-43ea-8b3a-3cece7352c1d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:37.557463 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b4ce36-eca9-43ea-8b3a-3cece7352c1d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:37.684672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-99b4ce36-eca9-43ea-8b3a-3cece7352c1d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:37.692484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-99b4ce36-eca9-43ea-8b3a-3cece7352c1d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148188 Jun 20 06:42:37.693034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1013/1954] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:37 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:38.709511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-94f35924-be2e-4161-b1db-ed0fe34d27c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:38.710864 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-94f35924-be2e-4161-b1db-ed0fe34d27c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:38.717404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94f35924-be2e-4161-b1db-ed0fe34d27c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:38.718016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94f35924-be2e-4161-b1db-ed0fe34d27c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:38.718785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94f35924-be2e-4161-b1db-ed0fe34d27c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:38.719227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94f35924-be2e-4161-b1db-ed0fe34d27c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:38.845776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94f35924-be2e-4161-b1db-ed0fe34d27c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:38.854278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-94f35924-be2e-4161-b1db-ed0fe34d27c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148051 Jun 20 06:42:38.854835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 942/1955] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:38 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:39.872393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-182ccc46-bfcd-422c-85a5-5dccdc6f8111 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:39.872984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-182ccc46-bfcd-422c-85a5-5dccdc6f8111 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:39.879526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-182ccc46-bfcd-422c-85a5-5dccdc6f8111 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:39.879972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-182ccc46-bfcd-422c-85a5-5dccdc6f8111 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:39.880729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-182ccc46-bfcd-422c-85a5-5dccdc6f8111 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:39.881168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-182ccc46-bfcd-422c-85a5-5dccdc6f8111 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:40.006787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-182ccc46-bfcd-422c-85a5-5dccdc6f8111 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:40.015557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-182ccc46-bfcd-422c-85a5-5dccdc6f8111 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147697 Jun 20 06:42:40.016112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1014/1956] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:39 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:41.032667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6679152a-894b-4918-bf68-62cf0f2e0f4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:41.033202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6679152a-894b-4918-bf68-62cf0f2e0f4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:41.039646 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6679152a-894b-4918-bf68-62cf0f2e0f4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:41.040109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6679152a-894b-4918-bf68-62cf0f2e0f4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:41.040849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6679152a-894b-4918-bf68-62cf0f2e0f4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:41.041277 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6679152a-894b-4918-bf68-62cf0f2e0f4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:41.172907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6679152a-894b-4918-bf68-62cf0f2e0f4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:41.180845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6679152a-894b-4918-bf68-62cf0f2e0f4d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152110 Jun 20 06:42:41.181427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 943/1957] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:41 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:42.200814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6ae832f7-c3a6-445f-a266-6f7aeb06d019 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:42.201337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6ae832f7-c3a6-445f-a266-6f7aeb06d019 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:42.207836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ae832f7-c3a6-445f-a266-6f7aeb06d019 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:42.208275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ae832f7-c3a6-445f-a266-6f7aeb06d019 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:42.209185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ae832f7-c3a6-445f-a266-6f7aeb06d019 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:42.209642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ae832f7-c3a6-445f-a266-6f7aeb06d019 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:42.335873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6ae832f7-c3a6-445f-a266-6f7aeb06d019 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:42.344327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6ae832f7-c3a6-445f-a266-6f7aeb06d019 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148189 Jun 20 06:42:42.344880 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1015/1958] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:42 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:43.362047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-32954039-0231-48b7-ad66-6bc5d0afaa6d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:43.362681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-32954039-0231-48b7-ad66-6bc5d0afaa6d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:43.365045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=26 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:43.370435 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32954039-0231-48b7-ad66-6bc5d0afaa6d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:43.371673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32954039-0231-48b7-ad66-6bc5d0afaa6d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:43.372178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32954039-0231-48b7-ad66-6bc5d0afaa6d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:43.372612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32954039-0231-48b7-ad66-6bc5d0afaa6d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:43.375364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=78 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:43.507009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-32954039-0231-48b7-ad66-6bc5d0afaa6d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:43.515253 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-32954039-0231-48b7-ad66-6bc5d0afaa6d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.157031 Jun 20 06:42:43.515825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 944/1959] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:43 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:44.532563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bda73912-28b1-45f9-a3c2-42097d0766c9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:44.533179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bda73912-28b1-45f9-a3c2-42097d0766c9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:44.535533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=26 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:44.540842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bda73912-28b1-45f9-a3c2-42097d0766c9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:44.541291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bda73912-28b1-45f9-a3c2-42097d0766c9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:44.542080 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bda73912-28b1-45f9-a3c2-42097d0766c9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:44.543089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bda73912-28b1-45f9-a3c2-42097d0766c9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:44.545796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=78 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:42:44.672037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bda73912-28b1-45f9-a3c2-42097d0766c9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:44.679978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bda73912-28b1-45f9-a3c2-42097d0766c9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151309 Jun 20 06:42:44.680544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1016/1960] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:44 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:45.697060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dac19e4a-8b4b-4170-9480-5963d125a9a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:45.697705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dac19e4a-8b4b-4170-9480-5963d125a9a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:45.704323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dac19e4a-8b4b-4170-9480-5963d125a9a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:45.704771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dac19e4a-8b4b-4170-9480-5963d125a9a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:45.705565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dac19e4a-8b4b-4170-9480-5963d125a9a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:45.706004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dac19e4a-8b4b-4170-9480-5963d125a9a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:45.836477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dac19e4a-8b4b-4170-9480-5963d125a9a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:45.844477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dac19e4a-8b4b-4170-9480-5963d125a9a2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151397 Jun 20 06:42:45.845036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 945/1961] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:45 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:46.861841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2ac54ef4-f9d3-440d-a02a-0fb33b712045 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:46.862458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2ac54ef4-f9d3-440d-a02a-0fb33b712045 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:46.868813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ac54ef4-f9d3-440d-a02a-0fb33b712045 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:46.869264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ac54ef4-f9d3-440d-a02a-0fb33b712045 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:46.870064 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ac54ef4-f9d3-440d-a02a-0fb33b712045 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:46.870504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ac54ef4-f9d3-440d-a02a-0fb33b712045 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:46.997772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2ac54ef4-f9d3-440d-a02a-0fb33b712045 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:47.005740 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2ac54ef4-f9d3-440d-a02a-0fb33b712045 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147736 Jun 20 06:42:47.006306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1017/1962] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:46 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:48.023231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1e2a8a5a-8523-4826-855d-604c19f8ead7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:48.023843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1e2a8a5a-8523-4826-855d-604c19f8ead7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:48.030488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e2a8a5a-8523-4826-855d-604c19f8ead7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:48.030938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e2a8a5a-8523-4826-855d-604c19f8ead7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:48.031698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e2a8a5a-8523-4826-855d-604c19f8ead7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:48.032140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e2a8a5a-8523-4826-855d-604c19f8ead7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:48.158205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1e2a8a5a-8523-4826-855d-604c19f8ead7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:48.166999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1e2a8a5a-8523-4826-855d-604c19f8ead7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147614 Jun 20 06:42:48.168139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 946/1963] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:48 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:49.184721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d1767c7-c293-4026-9289-4fd9494e9d7b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:49.185268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6d1767c7-c293-4026-9289-4fd9494e9d7b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:49.191655 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d1767c7-c293-4026-9289-4fd9494e9d7b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:49.192105 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d1767c7-c293-4026-9289-4fd9494e9d7b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:49.192871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d1767c7-c293-4026-9289-4fd9494e9d7b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:49.193308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d1767c7-c293-4026-9289-4fd9494e9d7b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:49.328570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6d1767c7-c293-4026-9289-4fd9494e9d7b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:49.336391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6d1767c7-c293-4026-9289-4fd9494e9d7b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.156356 Jun 20 06:42:49.336948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1018/1964] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:49 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:50.354118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60b6cbca-9557-4880-ab22-e3c423c3f709 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:50.354730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-60b6cbca-9557-4880-ab22-e3c423c3f709 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:50.362142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60b6cbca-9557-4880-ab22-e3c423c3f709 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:50.362595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60b6cbca-9557-4880-ab22-e3c423c3f709 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:50.363358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60b6cbca-9557-4880-ab22-e3c423c3f709 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:50.363794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60b6cbca-9557-4880-ab22-e3c423c3f709 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:50.490686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-60b6cbca-9557-4880-ab22-e3c423c3f709 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:50.498721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-60b6cbca-9557-4880-ab22-e3c423c3f709 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148432 Jun 20 06:42:50.499293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 947/1965] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:50 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:42:51.515875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a46a87c9-2dfd-4cc2-99ec-55be07828391 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:51.516480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a46a87c9-2dfd-4cc2-99ec-55be07828391 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:51.522931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a46a87c9-2dfd-4cc2-99ec-55be07828391 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:51.523378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a46a87c9-2dfd-4cc2-99ec-55be07828391 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:51.524129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a46a87c9-2dfd-4cc2-99ec-55be07828391 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:51.524557 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a46a87c9-2dfd-4cc2-99ec-55be07828391 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:51.653650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a46a87c9-2dfd-4cc2-99ec-55be07828391 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:51.661457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a46a87c9-2dfd-4cc2-99ec-55be07828391 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149751 Jun 20 06:42:51.662035 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1019/1966] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:51 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:52.679048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8f3f1235-8bf7-43bb-ab30-669fbdbb67ee tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:52.679663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8f3f1235-8bf7-43bb-ab30-669fbdbb67ee tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:52.686602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f3f1235-8bf7-43bb-ab30-669fbdbb67ee tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:52.687042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f3f1235-8bf7-43bb-ab30-669fbdbb67ee tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:52.687794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f3f1235-8bf7-43bb-ab30-669fbdbb67ee tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:52.688226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f3f1235-8bf7-43bb-ab30-669fbdbb67ee tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:52.814148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8f3f1235-8bf7-43bb-ab30-669fbdbb67ee tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:52.822037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8f3f1235-8bf7-43bb-ab30-669fbdbb67ee tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146818 Jun 20 06:42:52.822601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 948/1967] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:52 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:53.840423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1a32df62-58bf-426b-b26f-260979a4a1e6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:53.841047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1a32df62-58bf-426b-b26f-260979a4a1e6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:53.847572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a32df62-58bf-426b-b26f-260979a4a1e6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:53.848019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a32df62-58bf-426b-b26f-260979a4a1e6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:53.848772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a32df62-58bf-426b-b26f-260979a4a1e6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:53.849206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a32df62-58bf-426b-b26f-260979a4a1e6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:53.973988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1a32df62-58bf-426b-b26f-260979a4a1e6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:53.981806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1a32df62-58bf-426b-b26f-260979a4a1e6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146300 Jun 20 06:42:53.982370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1020/1968] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:53 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:54.998726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7958c71c-db44-44a8-8b7d-cceefba3451a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:54.999333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7958c71c-db44-44a8-8b7d-cceefba3451a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:55.006178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7958c71c-db44-44a8-8b7d-cceefba3451a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:55.006616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7958c71c-db44-44a8-8b7d-cceefba3451a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:55.007373 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7958c71c-db44-44a8-8b7d-cceefba3451a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:55.007804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7958c71c-db44-44a8-8b7d-cceefba3451a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:55.140866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7958c71c-db44-44a8-8b7d-cceefba3451a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:55.148709 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7958c71c-db44-44a8-8b7d-cceefba3451a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153881 Jun 20 06:42:55.149269 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 949/1969] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:54 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:56.166350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e8c62293-53c3-4dde-9618-2182a0e4ad3d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:56.166950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e8c62293-53c3-4dde-9618-2182a0e4ad3d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:56.173905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8c62293-53c3-4dde-9618-2182a0e4ad3d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:56.174348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8c62293-53c3-4dde-9618-2182a0e4ad3d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:56.175110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8c62293-53c3-4dde-9618-2182a0e4ad3d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:56.175543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8c62293-53c3-4dde-9618-2182a0e4ad3d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:56.303091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e8c62293-53c3-4dde-9618-2182a0e4ad3d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:56.311751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e8c62293-53c3-4dde-9618-2182a0e4ad3d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149272 Jun 20 06:42:56.312539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1021/1970] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:56 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:57.328784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-79d3617e-6351-4c60-a226-b11b3e7b7ace tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:57.329306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-79d3617e-6351-4c60-a226-b11b3e7b7ace tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:57.335749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79d3617e-6351-4c60-a226-b11b3e7b7ace tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:57.336180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79d3617e-6351-4c60-a226-b11b3e7b7ace tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:57.336935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79d3617e-6351-4c60-a226-b11b3e7b7ace tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:57.337363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79d3617e-6351-4c60-a226-b11b3e7b7ace tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:57.468237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79d3617e-6351-4c60-a226-b11b3e7b7ace tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:57.476066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-79d3617e-6351-4c60-a226-b11b3e7b7ace tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151232 Jun 20 06:42:57.476637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 950/1971] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:57 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:58.493686 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7418e10e-fe43-42c7-ae47-ea9441c31407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:58.499426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7418e10e-fe43-42c7-ae47-ea9441c31407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:58.506100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7418e10e-fe43-42c7-ae47-ea9441c31407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:58.506560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7418e10e-fe43-42c7-ae47-ea9441c31407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:58.507338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7418e10e-fe43-42c7-ae47-ea9441c31407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:58.507769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7418e10e-fe43-42c7-ae47-ea9441c31407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:58.956419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7418e10e-fe43-42c7-ae47-ea9441c31407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:58.965844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7418e10e-fe43-42c7-ae47-ea9441c31407 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.476045 Jun 20 06:42:58.966618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1022/1972] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:58 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:59.580506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-da0bfd19-1ec5-4497-bc97-30659c93c25f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:59.581012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-da0bfd19-1ec5-4497-bc97-30659c93c25f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:59.589787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da0bfd19-1ec5-4497-bc97-30659c93c25f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:59.590252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da0bfd19-1ec5-4497-bc97-30659c93c25f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:59.591036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da0bfd19-1ec5-4497-bc97-30659c93c25f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:59.591478 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da0bfd19-1ec5-4497-bc97-30659c93c25f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:59.620904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-da0bfd19-1ec5-4497-bc97-30659c93c25f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:42:59.648545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-d59da815-7b37-42a4-8fd8-d355d91f4c7f req-cd8a0b6f-e596-4d8c-a8f2-896d1caa9353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32410ddb-881f-46f6-b3c6-67399fd5b53b", "tag": "047b28e6-c7ee-4057-bd43-5589a50b5f51"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:42:59.657092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-d59da815-7b37-42a4-8fd8-d355d91f4c7f req-cd8a0b6f-e596-4d8c-a8f2-896d1caa9353 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:59.657833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-d59da815-7b37-42a4-8fd8-d355d91f4c7f req-cd8a0b6f-e596-4d8c-a8f2-896d1caa9353 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:59.670162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-d59da815-7b37-42a4-8fd8-d355d91f4c7f req-cd8a0b6f-e596-4d8c-a8f2-896d1caa9353 service nova] Creating event network-changed:047b28e6-c7ee-4057-bd43-5589a50b5f51 for instance 32410ddb-881f-46f6-b3c6-67399fd5b53b on hv-cinder-80473 Jun 20 06:42:59.674139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR oslo.messaging._drivers.impl_rabbit [req-d59da815-7b37-42a4-8fd8-d355d91f4c7f req-cd8a0b6f-e596-4d8c-a8f2-896d1caa9353 service nova] [dbc8f159-34df-42c3-a347-a93ff689be44] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 06:42:59.702398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-da0bfd19-1ec5-4497-bc97-30659c93c25f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "DELETE /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 204 len: 0 microversion: 2.1 time: 0.125442 Jun 20 06:42:59.703165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 951/1973] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:42:59 2022] DELETE /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:42:59.714489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6db4c4f1-6f89-4059-a61a-53477c0c6b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:59.715192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6db4c4f1-6f89-4059-a61a-53477c0c6b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:59.721099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6db4c4f1-6f89-4059-a61a-53477c0c6b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:59.721609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6db4c4f1-6f89-4059-a61a-53477c0c6b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:59.722385 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6db4c4f1-6f89-4059-a61a-53477c0c6b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:59.722816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6db4c4f1-6f89-4059-a61a-53477c0c6b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:59.860857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6db4c4f1-6f89-4059-a61a-53477c0c6b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:42:59.868844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6db4c4f1-6f89-4059-a61a-53477c0c6b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1576 microversion: 2.1 time: 0.158464 Jun 20 06:42:59.869438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 952/1974] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:59 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:42:59.983667 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c6bcb2a5-0768-4585-a4ef-1af9d41575fc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:42:59.984400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c6bcb2a5-0768-4585-a4ef-1af9d41575fc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:42:59.990541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6bcb2a5-0768-4585-a4ef-1af9d41575fc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:59.991000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6bcb2a5-0768-4585-a4ef-1af9d41575fc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:42:59.991786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6bcb2a5-0768-4585-a4ef-1af9d41575fc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:42:59.992227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6bcb2a5-0768-4585-a4ef-1af9d41575fc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:00.108165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:43:00.108435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:43:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Jun 20 06:43:00.123843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c6bcb2a5-0768-4585-a4ef-1af9d41575fc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:00.131693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c6bcb2a5-0768-4585-a4ef-1af9d41575fc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152349 Jun 20 06:43:00.132243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 953/1975] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:42:59 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:00.680676 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [req-d59da815-7b37-42a4-8fd8-d355d91f4c7f req-cd8a0b6f-e596-4d8c-a8f2-896d1caa9353 service nova] [dbc8f159-34df-42c3-a347-a93ff689be44] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44506. Jun 20 06:43:00.684956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-d59da815-7b37-42a4-8fd8-d355d91f4c7f req-cd8a0b6f-e596-4d8c-a8f2-896d1caa9353 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.106263 Jun 20 06:43:00.685658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1023/1976] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:43:00.887613 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5ccf142d-9338-4d5c-959c-a209a55901dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:00.888534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5ccf142d-9338-4d5c-959c-a209a55901dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:00.896203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ccf142d-9338-4d5c-959c-a209a55901dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:00.896662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ccf142d-9338-4d5c-959c-a209a55901dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:00.897464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ccf142d-9338-4d5c-959c-a209a55901dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:00.897907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ccf142d-9338-4d5c-959c-a209a55901dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:01.129437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5ccf142d-9338-4d5c-959c-a209a55901dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:01.138257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5ccf142d-9338-4d5c-959c-a209a55901dd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1576 microversion: 2.1 time: 0.254979 Jun 20 06:43:01.138990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 954/1977] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:00 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:01.149701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-294b6d15-cc34-4d66-8c14-71d06a8d5e61 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:01.150925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-294b6d15-cc34-4d66-8c14-71d06a8d5e61 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:01.158617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-294b6d15-cc34-4d66-8c14-71d06a8d5e61 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:01.159194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-294b6d15-cc34-4d66-8c14-71d06a8d5e61 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:01.160097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-294b6d15-cc34-4d66-8c14-71d06a8d5e61 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:01.160734 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-294b6d15-cc34-4d66-8c14-71d06a8d5e61 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:01.362805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-efe09d5f-5a58-49cc-8d2c-3eab4e811a95 req-72fbf677-b468-40d0-987d-b24aeea13c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32410ddb-881f-46f6-b3c6-67399fd5b53b", "name": "network-vif-deleted", "tag": "047b28e6-c7ee-4057-bd43-5589a50b5f51"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:43:01.371339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-efe09d5f-5a58-49cc-8d2c-3eab4e811a95 req-72fbf677-b468-40d0-987d-b24aeea13c69 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:01.371787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-efe09d5f-5a58-49cc-8d2c-3eab4e811a95 req-72fbf677-b468-40d0-987d-b24aeea13c69 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:01.382479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-efe09d5f-5a58-49cc-8d2c-3eab4e811a95 req-72fbf677-b468-40d0-987d-b24aeea13c69 service nova] Creating event network-vif-deleted:047b28e6-c7ee-4057-bd43-5589a50b5f51 for instance 32410ddb-881f-46f6-b3c6-67399fd5b53b on hv-cinder-80473 Jun 20 06:43:01.384427 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-294b6d15-cc34-4d66-8c14-71d06a8d5e61 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:01.388920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-efe09d5f-5a58-49cc-8d2c-3eab4e811a95 req-72fbf677-b468-40d0-987d-b24aeea13c69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106523 Jun 20 06:43:01.390491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 955/1978] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:43:01.396099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-294b6d15-cc34-4d66-8c14-71d06a8d5e61 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.251448 Jun 20 06:43:01.396706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1024/1979] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:01 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:02.156946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5b870183-eed8-46cc-9a70-89a6946c7d84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:02.157679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5b870183-eed8-46cc-9a70-89a6946c7d84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:02.163877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b870183-eed8-46cc-9a70-89a6946c7d84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:02.164331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b870183-eed8-46cc-9a70-89a6946c7d84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:02.165095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b870183-eed8-46cc-9a70-89a6946c7d84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:02.165579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b870183-eed8-46cc-9a70-89a6946c7d84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:02.227953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5b870183-eed8-46cc-9a70-89a6946c7d84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:02.236014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5b870183-eed8-46cc-9a70-89a6946c7d84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084090 Jun 20 06:43:02.236578 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 956/1980] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:02 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:02.414011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e8b71330-d008-4765-9b6b-7de5973369c2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:02.414564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e8b71330-d008-4765-9b6b-7de5973369c2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:02.421903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8b71330-d008-4765-9b6b-7de5973369c2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:02.422346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8b71330-d008-4765-9b6b-7de5973369c2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:02.423102 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8b71330-d008-4765-9b6b-7de5973369c2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:02.423528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e8b71330-d008-4765-9b6b-7de5973369c2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:02.554974 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e8b71330-d008-4765-9b6b-7de5973369c2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:02.562874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e8b71330-d008-4765-9b6b-7de5973369c2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152764 Jun 20 06:43:02.563431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1025/1981] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:02 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:03.252399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d529f2f3-1b92-484c-8c0a-23eacd6224b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:03.252963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d529f2f3-1b92-484c-8c0a-23eacd6224b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:03.259499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d529f2f3-1b92-484c-8c0a-23eacd6224b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:03.259979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d529f2f3-1b92-484c-8c0a-23eacd6224b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:03.261537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d529f2f3-1b92-484c-8c0a-23eacd6224b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:03.261978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d529f2f3-1b92-484c-8c0a-23eacd6224b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:03.322454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d529f2f3-1b92-484c-8c0a-23eacd6224b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:03.331417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d529f2f3-1b92-484c-8c0a-23eacd6224b1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083011 Jun 20 06:43:03.332026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 957/1982] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:03 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:03.579969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-83d095c4-0ce2-40fe-a7a7-4782c9460416 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:03.580517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-83d095c4-0ce2-40fe-a7a7-4782c9460416 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:03.586471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83d095c4-0ce2-40fe-a7a7-4782c9460416 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:03.586923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83d095c4-0ce2-40fe-a7a7-4782c9460416 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:03.587685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83d095c4-0ce2-40fe-a7a7-4782c9460416 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:03.588122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83d095c4-0ce2-40fe-a7a7-4782c9460416 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:03.714185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-83d095c4-0ce2-40fe-a7a7-4782c9460416 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:03.722240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-83d095c4-0ce2-40fe-a7a7-4782c9460416 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146388 Jun 20 06:43:03.722807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1026/1983] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:03 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:04.348051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-043cac11-b8a9-4741-bc15-dde1749d9aca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:04.348665 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-043cac11-b8a9-4741-bc15-dde1749d9aca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:04.355115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-043cac11-b8a9-4741-bc15-dde1749d9aca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:04.355555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-043cac11-b8a9-4741-bc15-dde1749d9aca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:04.356308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-043cac11-b8a9-4741-bc15-dde1749d9aca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:04.356748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-043cac11-b8a9-4741-bc15-dde1749d9aca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:04.419210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-043cac11-b8a9-4741-bc15-dde1749d9aca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:04.426588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-043cac11-b8a9-4741-bc15-dde1749d9aca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082399 Jun 20 06:43:04.427143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 958/1984] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:04 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:04.740140 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1b808f75-cb6e-400a-b6b1-0427c5cf5343 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:04.740760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1b808f75-cb6e-400a-b6b1-0427c5cf5343 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:04.747982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b808f75-cb6e-400a-b6b1-0427c5cf5343 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:04.748431 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b808f75-cb6e-400a-b6b1-0427c5cf5343 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:04.749191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b808f75-cb6e-400a-b6b1-0427c5cf5343 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:04.749663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b808f75-cb6e-400a-b6b1-0427c5cf5343 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:04.881781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1b808f75-cb6e-400a-b6b1-0427c5cf5343 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:04.892273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1b808f75-cb6e-400a-b6b1-0427c5cf5343 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.155999 Jun 20 06:43:04.892950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1027/1985] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:04 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:05.443397 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9e88579f-291d-410b-a82a-787bc98ec1cf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:05.444042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9e88579f-291d-410b-a82a-787bc98ec1cf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:05.450840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e88579f-291d-410b-a82a-787bc98ec1cf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:05.451291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e88579f-291d-410b-a82a-787bc98ec1cf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:05.452054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e88579f-291d-410b-a82a-787bc98ec1cf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:05.452493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e88579f-291d-410b-a82a-787bc98ec1cf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:05.518238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9e88579f-291d-410b-a82a-787bc98ec1cf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:05.520538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:05.527950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9e88579f-291d-410b-a82a-787bc98ec1cf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.088371 Jun 20 06:43:05.528519 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 959/1986] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:05 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:05.909573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d1288339-6e22-4cad-9bbd-ac394fdad7c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:05.910179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d1288339-6e22-4cad-9bbd-ac394fdad7c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:05.916587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1288339-6e22-4cad-9bbd-ac394fdad7c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:05.917052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1288339-6e22-4cad-9bbd-ac394fdad7c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:05.917834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1288339-6e22-4cad-9bbd-ac394fdad7c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:05.918263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1288339-6e22-4cad-9bbd-ac394fdad7c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:06.047371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d1288339-6e22-4cad-9bbd-ac394fdad7c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:06.055723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d1288339-6e22-4cad-9bbd-ac394fdad7c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149987 Jun 20 06:43:06.056286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1028/1987] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:05 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:06.545107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-21aa6d88-8969-46bc-8ef8-f2bb8229bd63 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:06.545750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-21aa6d88-8969-46bc-8ef8-f2bb8229bd63 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:06.553365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21aa6d88-8969-46bc-8ef8-f2bb8229bd63 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:06.553840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21aa6d88-8969-46bc-8ef8-f2bb8229bd63 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:06.554601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21aa6d88-8969-46bc-8ef8-f2bb8229bd63 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:06.555040 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-21aa6d88-8969-46bc-8ef8-f2bb8229bd63 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:06.615401 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-21aa6d88-8969-46bc-8ef8-f2bb8229bd63 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:06.623486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-21aa6d88-8969-46bc-8ef8-f2bb8229bd63 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082772 Jun 20 06:43:06.624047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 960/1988] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:06 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:07.074591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-51d6537d-5924-4ba9-9a80-24db23cc6b8c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:07.075200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-51d6537d-5924-4ba9-9a80-24db23cc6b8c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:07.081645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51d6537d-5924-4ba9-9a80-24db23cc6b8c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:07.082086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51d6537d-5924-4ba9-9a80-24db23cc6b8c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:07.082832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51d6537d-5924-4ba9-9a80-24db23cc6b8c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:07.083260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51d6537d-5924-4ba9-9a80-24db23cc6b8c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:07.207120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-51d6537d-5924-4ba9-9a80-24db23cc6b8c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:07.214926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-51d6537d-5924-4ba9-9a80-24db23cc6b8c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.144791 Jun 20 06:43:07.215486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1029/1989] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:07 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:07.640536 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cb83a9bf-8793-438a-9aa8-5b08d382bba4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:07.641155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cb83a9bf-8793-438a-9aa8-5b08d382bba4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:07.647759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb83a9bf-8793-438a-9aa8-5b08d382bba4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:07.648205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb83a9bf-8793-438a-9aa8-5b08d382bba4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:07.648964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb83a9bf-8793-438a-9aa8-5b08d382bba4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:07.649446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb83a9bf-8793-438a-9aa8-5b08d382bba4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:07.709174 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cb83a9bf-8793-438a-9aa8-5b08d382bba4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:07.717147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cb83a9bf-8793-438a-9aa8-5b08d382bba4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080726 Jun 20 06:43:07.717738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 961/1990] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:07 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:08.231034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-753e0f87-d44b-487d-874f-46878a1b5df9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:08.231669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-753e0f87-d44b-487d-874f-46878a1b5df9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:08.238108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-753e0f87-d44b-487d-874f-46878a1b5df9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:08.238552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-753e0f87-d44b-487d-874f-46878a1b5df9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:08.239304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-753e0f87-d44b-487d-874f-46878a1b5df9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:08.239735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-753e0f87-d44b-487d-874f-46878a1b5df9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:08.369507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-753e0f87-d44b-487d-874f-46878a1b5df9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:08.378019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-753e0f87-d44b-487d-874f-46878a1b5df9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150873 Jun 20 06:43:08.378579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1030/1991] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:08 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:08.734481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e55eeb11-902d-4434-9c46-b3cd40a20f5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:08.735075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e55eeb11-902d-4434-9c46-b3cd40a20f5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:08.741585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e55eeb11-902d-4434-9c46-b3cd40a20f5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:08.742032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e55eeb11-902d-4434-9c46-b3cd40a20f5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:08.742785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e55eeb11-902d-4434-9c46-b3cd40a20f5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:08.743217 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e55eeb11-902d-4434-9c46-b3cd40a20f5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:08.804344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e55eeb11-902d-4434-9c46-b3cd40a20f5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:08.812498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e55eeb11-902d-4434-9c46-b3cd40a20f5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081994 Jun 20 06:43:08.813055 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 962/1992] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:08 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:09.395009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0c2f1bd4-264a-49ef-89fd-e371a98c9705 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:09.395614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0c2f1bd4-264a-49ef-89fd-e371a98c9705 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:09.402625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c2f1bd4-264a-49ef-89fd-e371a98c9705 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:09.403068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c2f1bd4-264a-49ef-89fd-e371a98c9705 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:09.403815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c2f1bd4-264a-49ef-89fd-e371a98c9705 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:09.404242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c2f1bd4-264a-49ef-89fd-e371a98c9705 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:09.532764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0c2f1bd4-264a-49ef-89fd-e371a98c9705 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:09.540555 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0c2f1bd4-264a-49ef-89fd-e371a98c9705 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149426 Jun 20 06:43:09.541106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1031/1993] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:09 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:09.829869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a634d213-d237-4fac-aba2-f021617c768a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:09.830485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a634d213-d237-4fac-aba2-f021617c768a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:09.836987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a634d213-d237-4fac-aba2-f021617c768a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:09.837501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a634d213-d237-4fac-aba2-f021617c768a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:09.838276 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a634d213-d237-4fac-aba2-f021617c768a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:09.839085 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a634d213-d237-4fac-aba2-f021617c768a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:09.899330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a634d213-d237-4fac-aba2-f021617c768a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:09.907046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a634d213-d237-4fac-aba2-f021617c768a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081015 Jun 20 06:43:09.907609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 963/1994] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:09 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:10.672208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-736f708c-4888-41e6-bbc3-33ab40138f9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:10.672842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-736f708c-4888-41e6-bbc3-33ab40138f9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:10.678752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736f708c-4888-41e6-bbc3-33ab40138f9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:10.679195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736f708c-4888-41e6-bbc3-33ab40138f9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:10.679947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736f708c-4888-41e6-bbc3-33ab40138f9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:10.680376 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736f708c-4888-41e6-bbc3-33ab40138f9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:10.808503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-736f708c-4888-41e6-bbc3-33ab40138f9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:10.816314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-736f708c-4888-41e6-bbc3-33ab40138f9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.262776 Jun 20 06:43:10.816872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1032/1995] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:10 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:10.923450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-42b518c3-8cfd-4102-b1f1-fd6a3c1c06d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:10.924090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-42b518c3-8cfd-4102-b1f1-fd6a3c1c06d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:10.930690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42b518c3-8cfd-4102-b1f1-fd6a3c1c06d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:10.931136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42b518c3-8cfd-4102-b1f1-fd6a3c1c06d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:10.931889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42b518c3-8cfd-4102-b1f1-fd6a3c1c06d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:10.932957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42b518c3-8cfd-4102-b1f1-fd6a3c1c06d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:10.996116 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-42b518c3-8cfd-4102-b1f1-fd6a3c1c06d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:11.003551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-42b518c3-8cfd-4102-b1f1-fd6a3c1c06d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083941 Jun 20 06:43:11.004110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 964/1996] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:10 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:11.834480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a4099e40-934d-41b8-b991-12f91d0e2e74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:11.835083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a4099e40-934d-41b8-b991-12f91d0e2e74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:11.842613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4099e40-934d-41b8-b991-12f91d0e2e74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:11.843055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4099e40-934d-41b8-b991-12f91d0e2e74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:11.843803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4099e40-934d-41b8-b991-12f91d0e2e74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:11.844230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4099e40-934d-41b8-b991-12f91d0e2e74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:11.858585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:11.976402 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a4099e40-934d-41b8-b991-12f91d0e2e74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:11.984800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a4099e40-934d-41b8-b991-12f91d0e2e74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.154138 Jun 20 06:43:11.985360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1033/1997] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:11 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:12.019952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4b9370b2-7e96-474e-b46b-69f2b373f524 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:12.020587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4b9370b2-7e96-474e-b46b-69f2b373f524 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:12.027855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b9370b2-7e96-474e-b46b-69f2b373f524 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:12.028303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b9370b2-7e96-474e-b46b-69f2b373f524 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:12.029061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b9370b2-7e96-474e-b46b-69f2b373f524 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:12.029526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b9370b2-7e96-474e-b46b-69f2b373f524 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:12.090508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4b9370b2-7e96-474e-b46b-69f2b373f524 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:12.097930 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4b9370b2-7e96-474e-b46b-69f2b373f524 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081830 Jun 20 06:43:12.098494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 965/1998] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:12 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:13.001689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f01c11b2-8354-4d95-97cf-810e5b3b3da3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:13.002301 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f01c11b2-8354-4d95-97cf-810e5b3b3da3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:13.008769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f01c11b2-8354-4d95-97cf-810e5b3b3da3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:13.009215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f01c11b2-8354-4d95-97cf-810e5b3b3da3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:13.009996 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f01c11b2-8354-4d95-97cf-810e5b3b3da3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:13.010488 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f01c11b2-8354-4d95-97cf-810e5b3b3da3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:13.115047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cc723569-ec02-420a-9552-b40fdd206404 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:13.115743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cc723569-ec02-420a-9552-b40fdd206404 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:13.122985 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc723569-ec02-420a-9552-b40fdd206404 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:13.123443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc723569-ec02-420a-9552-b40fdd206404 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:13.124222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc723569-ec02-420a-9552-b40fdd206404 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:13.124668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc723569-ec02-420a-9552-b40fdd206404 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:13.141616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f01c11b2-8354-4d95-97cf-810e5b3b3da3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:13.149457 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f01c11b2-8354-4d95-97cf-810e5b3b3da3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151632 Jun 20 06:43:13.150022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1034/1999] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:12 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:13.187311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cc723569-ec02-420a-9552-b40fdd206404 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:13.195508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cc723569-ec02-420a-9552-b40fdd206404 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084357 Jun 20 06:43:13.196390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 966/2000] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:13 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:14.166494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-427894d8-1348-48e0-b788-05b485011df8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:14.167249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-427894d8-1348-48e0-b788-05b485011df8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:14.173892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-427894d8-1348-48e0-b788-05b485011df8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:14.174368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-427894d8-1348-48e0-b788-05b485011df8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:14.175119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-427894d8-1348-48e0-b788-05b485011df8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:14.175548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-427894d8-1348-48e0-b788-05b485011df8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:14.211886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7ebc8ca4-7464-4b14-b3ce-5cf1f858c1ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:14.212491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7ebc8ca4-7464-4b14-b3ce-5cf1f858c1ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:14.216115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:14.221511 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ebc8ca4-7464-4b14-b3ce-5cf1f858c1ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:14.221970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ebc8ca4-7464-4b14-b3ce-5cf1f858c1ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:14.222745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ebc8ca4-7464-4b14-b3ce-5cf1f858c1ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:14.223181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ebc8ca4-7464-4b14-b3ce-5cf1f858c1ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:14.298802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7ebc8ca4-7464-4b14-b3ce-5cf1f858c1ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:14.306376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7ebc8ca4-7464-4b14-b3ce-5cf1f858c1ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.098296 Jun 20 06:43:14.306941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 967/2001] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:14 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:14.327226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-427894d8-1348-48e0-b788-05b485011df8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:14.335176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-427894d8-1348-48e0-b788-05b485011df8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.172539 Jun 20 06:43:14.335746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1035/2002] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:14 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:15.322904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fa3d31d9-dd1c-4a9f-912c-fd86bf6e79ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:15.323497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fa3d31d9-dd1c-4a9f-912c-fd86bf6e79ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:15.329630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa3d31d9-dd1c-4a9f-912c-fd86bf6e79ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:15.330080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa3d31d9-dd1c-4a9f-912c-fd86bf6e79ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:15.330878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa3d31d9-dd1c-4a9f-912c-fd86bf6e79ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:15.331257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa3d31d9-dd1c-4a9f-912c-fd86bf6e79ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:15.352153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-42ff4664-e2f3-4042-b803-dee884581817 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:15.352799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-42ff4664-e2f3-4042-b803-dee884581817 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:15.356158 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=40 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:15.363417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42ff4664-e2f3-4042-b803-dee884581817 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:15.363873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42ff4664-e2f3-4042-b803-dee884581817 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:15.364650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42ff4664-e2f3-4042-b803-dee884581817 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:15.365089 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42ff4664-e2f3-4042-b803-dee884581817 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:15.394691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa3d31d9-dd1c-4a9f-912c-fd86bf6e79ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:15.403104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fa3d31d9-dd1c-4a9f-912c-fd86bf6e79ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084167 Jun 20 06:43:15.403784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 968/2003] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:15 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:15.495694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-42ff4664-e2f3-4042-b803-dee884581817 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:15.503567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-42ff4664-e2f3-4042-b803-dee884581817 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.155514 Jun 20 06:43:15.504298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1036/2004] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:15 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:16.420642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-27708705-0165-4467-98e3-d745dafadbcc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:16.421241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-27708705-0165-4467-98e3-d745dafadbcc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:16.427736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27708705-0165-4467-98e3-d745dafadbcc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:16.428184 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27708705-0165-4467-98e3-d745dafadbcc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:16.428933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27708705-0165-4467-98e3-d745dafadbcc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:16.429363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-27708705-0165-4467-98e3-d745dafadbcc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:16.489172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-27708705-0165-4467-98e3-d745dafadbcc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:16.497406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-27708705-0165-4467-98e3-d745dafadbcc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081181 Jun 20 06:43:16.497975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 969/2005] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:16 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:16.521222 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-86d7774c-a0dc-4382-a0ed-fb72a075a7d5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:16.521848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-86d7774c-a0dc-4382-a0ed-fb72a075a7d5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:16.528410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86d7774c-a0dc-4382-a0ed-fb72a075a7d5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:16.528856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86d7774c-a0dc-4382-a0ed-fb72a075a7d5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:16.529659 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86d7774c-a0dc-4382-a0ed-fb72a075a7d5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:16.530126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86d7774c-a0dc-4382-a0ed-fb72a075a7d5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:16.662035 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-86d7774c-a0dc-4382-a0ed-fb72a075a7d5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:16.670532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-86d7774c-a0dc-4382-a0ed-fb72a075a7d5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153060 Jun 20 06:43:16.671099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1037/2006] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:16 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:17.514334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1b108c39-54bd-449b-b1ef-6aafbff11726 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:17.514943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1b108c39-54bd-449b-b1ef-6aafbff11726 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:17.521484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b108c39-54bd-449b-b1ef-6aafbff11726 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:17.521944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b108c39-54bd-449b-b1ef-6aafbff11726 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:17.522699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b108c39-54bd-449b-b1ef-6aafbff11726 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:17.523133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b108c39-54bd-449b-b1ef-6aafbff11726 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:17.583818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b108c39-54bd-449b-b1ef-6aafbff11726 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:17.592100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1b108c39-54bd-449b-b1ef-6aafbff11726 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082191 Jun 20 06:43:17.592688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 970/2007] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:17 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:17.687946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-24882505-5058-45e2-9a6f-5609e37f6936 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:17.688562 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-24882505-5058-45e2-9a6f-5609e37f6936 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:17.695054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-24882505-5058-45e2-9a6f-5609e37f6936 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:17.695502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-24882505-5058-45e2-9a6f-5609e37f6936 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:17.696266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-24882505-5058-45e2-9a6f-5609e37f6936 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:17.696700 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-24882505-5058-45e2-9a6f-5609e37f6936 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:17.825952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-24882505-5058-45e2-9a6f-5609e37f6936 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:17.833787 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-24882505-5058-45e2-9a6f-5609e37f6936 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149575 Jun 20 06:43:17.834288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1038/2008] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:17 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:18.608935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-34938a70-ec30-4dd9-b2e5-241aa1df599d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:18.609547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-34938a70-ec30-4dd9-b2e5-241aa1df599d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:18.615879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34938a70-ec30-4dd9-b2e5-241aa1df599d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:18.616324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34938a70-ec30-4dd9-b2e5-241aa1df599d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:18.617077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34938a70-ec30-4dd9-b2e5-241aa1df599d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:18.617549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34938a70-ec30-4dd9-b2e5-241aa1df599d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:18.683682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-34938a70-ec30-4dd9-b2e5-241aa1df599d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:18.691195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-34938a70-ec30-4dd9-b2e5-241aa1df599d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086190 Jun 20 06:43:18.691763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 971/2009] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:18 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:18.851812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6851619d-6030-4d5d-943e-d18ae2f2acf7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:18.852417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6851619d-6030-4d5d-943e-d18ae2f2acf7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:18.859167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6851619d-6030-4d5d-943e-d18ae2f2acf7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:18.859553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6851619d-6030-4d5d-943e-d18ae2f2acf7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:18.860296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6851619d-6030-4d5d-943e-d18ae2f2acf7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:18.860722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6851619d-6030-4d5d-943e-d18ae2f2acf7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:18.988813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6851619d-6030-4d5d-943e-d18ae2f2acf7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:18.997239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6851619d-6030-4d5d-943e-d18ae2f2acf7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149225 Jun 20 06:43:18.997822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1039/2010] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:18 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:19.708359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-221ca26e-e2cb-4146-a6ec-fe95959ed231 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:19.708972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-221ca26e-e2cb-4146-a6ec-fe95959ed231 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:19.715949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-221ca26e-e2cb-4146-a6ec-fe95959ed231 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:19.716399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-221ca26e-e2cb-4146-a6ec-fe95959ed231 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:19.717160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-221ca26e-e2cb-4146-a6ec-fe95959ed231 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:19.717619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-221ca26e-e2cb-4146-a6ec-fe95959ed231 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:19.777744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-221ca26e-e2cb-4146-a6ec-fe95959ed231 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:19.785129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-221ca26e-e2cb-4146-a6ec-fe95959ed231 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080590 Jun 20 06:43:19.785724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 972/2011] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:19 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:20.014965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-63842105-e33b-4434-9fe5-9fd69acf4b15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:20.015496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-63842105-e33b-4434-9fe5-9fd69acf4b15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:20.022128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63842105-e33b-4434-9fe5-9fd69acf4b15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:20.022577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63842105-e33b-4434-9fe5-9fd69acf4b15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:20.023335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63842105-e33b-4434-9fe5-9fd69acf4b15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:20.023767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63842105-e33b-4434-9fe5-9fd69acf4b15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:20.160735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-63842105-e33b-4434-9fe5-9fd69acf4b15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:20.169188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-63842105-e33b-4434-9fe5-9fd69acf4b15 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.158870 Jun 20 06:43:20.169779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1040/2012] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:20 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:20.802889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4da5e069-85f0-4f38-b410-3a3f89d7752d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:20.803480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4da5e069-85f0-4f38-b410-3a3f89d7752d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:20.810634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4da5e069-85f0-4f38-b410-3a3f89d7752d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:20.811080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4da5e069-85f0-4f38-b410-3a3f89d7752d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:20.811837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4da5e069-85f0-4f38-b410-3a3f89d7752d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:20.812272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4da5e069-85f0-4f38-b410-3a3f89d7752d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:20.875276 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4da5e069-85f0-4f38-b410-3a3f89d7752d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:20.882738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4da5e069-85f0-4f38-b410-3a3f89d7752d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083892 Jun 20 06:43:20.883303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 973/2013] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:20 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:21.186306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-098c5de2-a0b1-4135-a3ec-3eeca6a6ec58 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:21.186861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-098c5de2-a0b1-4135-a3ec-3eeca6a6ec58 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:21.193503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-098c5de2-a0b1-4135-a3ec-3eeca6a6ec58 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:21.193953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-098c5de2-a0b1-4135-a3ec-3eeca6a6ec58 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:21.194714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-098c5de2-a0b1-4135-a3ec-3eeca6a6ec58 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:21.195153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-098c5de2-a0b1-4135-a3ec-3eeca6a6ec58 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:21.322240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-098c5de2-a0b1-4135-a3ec-3eeca6a6ec58 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:21.331320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-098c5de2-a0b1-4135-a3ec-3eeca6a6ec58 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149574 Jun 20 06:43:21.331898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1041/2014] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:21 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:21.899697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1680b557-e923-4b30-8f25-09e1adfc3728 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:21.900342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1680b557-e923-4b30-8f25-09e1adfc3728 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:21.906792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1680b557-e923-4b30-8f25-09e1adfc3728 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:21.907241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1680b557-e923-4b30-8f25-09e1adfc3728 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:21.908005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1680b557-e923-4b30-8f25-09e1adfc3728 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:21.908437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1680b557-e923-4b30-8f25-09e1adfc3728 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:21.972481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1680b557-e923-4b30-8f25-09e1adfc3728 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:21.980538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1680b557-e923-4b30-8f25-09e1adfc3728 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084744 Jun 20 06:43:21.981102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 974/2015] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:21 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:22.348122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-50ec9455-e864-427c-9cb3-ea1ea484aa2f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:22.348739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-50ec9455-e864-427c-9cb3-ea1ea484aa2f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:22.355737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50ec9455-e864-427c-9cb3-ea1ea484aa2f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:22.356190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50ec9455-e864-427c-9cb3-ea1ea484aa2f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:22.356959 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50ec9455-e864-427c-9cb3-ea1ea484aa2f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:22.357415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50ec9455-e864-427c-9cb3-ea1ea484aa2f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:22.484313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-50ec9455-e864-427c-9cb3-ea1ea484aa2f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:22.492124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-50ec9455-e864-427c-9cb3-ea1ea484aa2f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147904 Jun 20 06:43:22.492690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1042/2016] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:22 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:22.998161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-971752cb-70cf-4948-b659-95b40bdd931d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:22.998804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-971752cb-70cf-4948-b659-95b40bdd931d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:23.005607 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-971752cb-70cf-4948-b659-95b40bdd931d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:23.006060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-971752cb-70cf-4948-b659-95b40bdd931d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:23.006822 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-971752cb-70cf-4948-b659-95b40bdd931d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:23.007258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-971752cb-70cf-4948-b659-95b40bdd931d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:23.067937 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-971752cb-70cf-4948-b659-95b40bdd931d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:23.076520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-971752cb-70cf-4948-b659-95b40bdd931d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082335 Jun 20 06:43:23.077092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 975/2017] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:22 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:23.509177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-903f58b9-97c8-42ef-b73f-8fdb0835f13d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:23.509819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-903f58b9-97c8-42ef-b73f-8fdb0835f13d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:23.517677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-903f58b9-97c8-42ef-b73f-8fdb0835f13d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:23.518125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-903f58b9-97c8-42ef-b73f-8fdb0835f13d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:23.518884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-903f58b9-97c8-42ef-b73f-8fdb0835f13d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:23.519315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-903f58b9-97c8-42ef-b73f-8fdb0835f13d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:23.649675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-903f58b9-97c8-42ef-b73f-8fdb0835f13d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:23.657678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-903f58b9-97c8-42ef-b73f-8fdb0835f13d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152324 Jun 20 06:43:23.658241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1043/2018] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:23 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:24.093934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3bf0c984-c753-4fe1-bfe9-0933f5b5e9ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:24.094553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3bf0c984-c753-4fe1-bfe9-0933f5b5e9ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:24.101044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3bf0c984-c753-4fe1-bfe9-0933f5b5e9ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:24.101534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3bf0c984-c753-4fe1-bfe9-0933f5b5e9ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:24.102308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3bf0c984-c753-4fe1-bfe9-0933f5b5e9ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:24.102754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3bf0c984-c753-4fe1-bfe9-0933f5b5e9ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:24.118330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:24.165326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3bf0c984-c753-4fe1-bfe9-0933f5b5e9ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:24.173551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3bf0c984-c753-4fe1-bfe9-0933f5b5e9ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083485 Jun 20 06:43:24.174124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 976/2019] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:24 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:24.675291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-452095b8-1ec7-4cb2-a484-8502e7f698ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:24.675900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-452095b8-1ec7-4cb2-a484-8502e7f698ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:24.682450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-452095b8-1ec7-4cb2-a484-8502e7f698ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:24.682889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-452095b8-1ec7-4cb2-a484-8502e7f698ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:24.683643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-452095b8-1ec7-4cb2-a484-8502e7f698ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:24.684069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-452095b8-1ec7-4cb2-a484-8502e7f698ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:24.814504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-452095b8-1ec7-4cb2-a484-8502e7f698ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:24.822266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-452095b8-1ec7-4cb2-a484-8502e7f698ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150940 Jun 20 06:43:24.823376 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1044/2020] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:24 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:25.190734 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4e06931b-1081-403e-af8f-f56535bbbb8f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:25.191295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4e06931b-1081-403e-af8f-f56535bbbb8f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:25.197656 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4e06931b-1081-403e-af8f-f56535bbbb8f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:25.198173 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4e06931b-1081-403e-af8f-f56535bbbb8f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:25.198843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4e06931b-1081-403e-af8f-f56535bbbb8f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:25.199270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4e06931b-1081-403e-af8f-f56535bbbb8f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:25.262289 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4e06931b-1081-403e-af8f-f56535bbbb8f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:25.269933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4e06931b-1081-403e-af8f-f56535bbbb8f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083119 Jun 20 06:43:25.270493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 977/2021] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:25 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:25.840513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0942a9fe-ba04-4512-8a77-744b299f534f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:25.841115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0942a9fe-ba04-4512-8a77-744b299f534f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:25.847568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0942a9fe-ba04-4512-8a77-744b299f534f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:25.848005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0942a9fe-ba04-4512-8a77-744b299f534f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:25.848749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0942a9fe-ba04-4512-8a77-744b299f534f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:25.849251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0942a9fe-ba04-4512-8a77-744b299f534f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:25.976583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0942a9fe-ba04-4512-8a77-744b299f534f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:25.984705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0942a9fe-ba04-4512-8a77-744b299f534f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148604 Jun 20 06:43:25.985258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1045/2022] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:25 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:26.286097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ad5a118a-026e-41be-8be8-0244b8b9727c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:26.286712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ad5a118a-026e-41be-8be8-0244b8b9727c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:26.293196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad5a118a-026e-41be-8be8-0244b8b9727c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:26.293685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad5a118a-026e-41be-8be8-0244b8b9727c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:26.294457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad5a118a-026e-41be-8be8-0244b8b9727c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:26.294898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad5a118a-026e-41be-8be8-0244b8b9727c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:26.358247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ad5a118a-026e-41be-8be8-0244b8b9727c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:26.365782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ad5a118a-026e-41be-8be8-0244b8b9727c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083480 Jun 20 06:43:26.366347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 978/2023] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:26 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:27.001718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e23f0b18-9b63-46bc-810c-8c49391d7534 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:27.002325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e23f0b18-9b63-46bc-810c-8c49391d7534 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:27.008672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e23f0b18-9b63-46bc-810c-8c49391d7534 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:27.009113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e23f0b18-9b63-46bc-810c-8c49391d7534 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:27.009977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e23f0b18-9b63-46bc-810c-8c49391d7534 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:27.010419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e23f0b18-9b63-46bc-810c-8c49391d7534 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:27.141831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e23f0b18-9b63-46bc-810c-8c49391d7534 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:27.149708 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e23f0b18-9b63-46bc-810c-8c49391d7534 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151869 Jun 20 06:43:27.150269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1046/2024] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:26 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:27.383364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6cb2e4d6-eb4f-4ad2-b640-6c3af652c59a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:27.384624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6cb2e4d6-eb4f-4ad2-b640-6c3af652c59a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:27.391649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cb2e4d6-eb4f-4ad2-b640-6c3af652c59a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:27.392118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cb2e4d6-eb4f-4ad2-b640-6c3af652c59a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:27.392870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cb2e4d6-eb4f-4ad2-b640-6c3af652c59a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:27.393308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6cb2e4d6-eb4f-4ad2-b640-6c3af652c59a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:27.456032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6cb2e4d6-eb4f-4ad2-b640-6c3af652c59a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:27.464273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6cb2e4d6-eb4f-4ad2-b640-6c3af652c59a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084735 Jun 20 06:43:27.464837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 979/2025] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:27 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:28.167840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4b99a0bf-5605-4166-b0cc-1f44e27e643e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:28.168469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4b99a0bf-5605-4166-b0cc-1f44e27e643e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:28.175060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b99a0bf-5605-4166-b0cc-1f44e27e643e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:28.175505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b99a0bf-5605-4166-b0cc-1f44e27e643e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:28.176260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b99a0bf-5605-4166-b0cc-1f44e27e643e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:28.176691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b99a0bf-5605-4166-b0cc-1f44e27e643e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:28.302950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4b99a0bf-5605-4166-b0cc-1f44e27e643e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:28.311830 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4b99a0bf-5605-4166-b0cc-1f44e27e643e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148510 Jun 20 06:43:28.312394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1047/2026] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:28 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:28.483456 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9d3b4442-3272-40cc-8038-e412f9915039 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:28.483991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9d3b4442-3272-40cc-8038-e412f9915039 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:28.489987 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d3b4442-3272-40cc-8038-e412f9915039 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:28.490437 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d3b4442-3272-40cc-8038-e412f9915039 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:28.491195 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d3b4442-3272-40cc-8038-e412f9915039 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:28.491631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d3b4442-3272-40cc-8038-e412f9915039 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:28.555951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9d3b4442-3272-40cc-8038-e412f9915039 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:28.564072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9d3b4442-3272-40cc-8038-e412f9915039 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086667 Jun 20 06:43:28.564634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 980/2027] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:28 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:29.328814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0b96bb69-813a-4dff-88d2-d4b0a84f0fe3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:29.329406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0b96bb69-813a-4dff-88d2-d4b0a84f0fe3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:29.335980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0b96bb69-813a-4dff-88d2-d4b0a84f0fe3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:29.336432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0b96bb69-813a-4dff-88d2-d4b0a84f0fe3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:29.337198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0b96bb69-813a-4dff-88d2-d4b0a84f0fe3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:29.337658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0b96bb69-813a-4dff-88d2-d4b0a84f0fe3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:29.463894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0b96bb69-813a-4dff-88d2-d4b0a84f0fe3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:29.471668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0b96bb69-813a-4dff-88d2-d4b0a84f0fe3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146824 Jun 20 06:43:29.472223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1048/2028] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:29 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:29.580867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-18cc0571-efb1-4d20-9225-aeb1b433c26c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:29.581407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-18cc0571-efb1-4d20-9225-aeb1b433c26c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:29.587784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18cc0571-efb1-4d20-9225-aeb1b433c26c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:29.588231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18cc0571-efb1-4d20-9225-aeb1b433c26c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:29.588980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18cc0571-efb1-4d20-9225-aeb1b433c26c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:29.589436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18cc0571-efb1-4d20-9225-aeb1b433c26c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:29.650221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-18cc0571-efb1-4d20-9225-aeb1b433c26c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:29.657660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-18cc0571-efb1-4d20-9225-aeb1b433c26c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080603 Jun 20 06:43:29.658243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 981/2029] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:29 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:30.488875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ba9b9a7a-563a-41d0-9ea5-b5dd59a20885 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:30.489518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ba9b9a7a-563a-41d0-9ea5-b5dd59a20885 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:30.496384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba9b9a7a-563a-41d0-9ea5-b5dd59a20885 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:30.496836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba9b9a7a-563a-41d0-9ea5-b5dd59a20885 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:30.497645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba9b9a7a-563a-41d0-9ea5-b5dd59a20885 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:30.498084 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba9b9a7a-563a-41d0-9ea5-b5dd59a20885 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:30.629351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ba9b9a7a-563a-41d0-9ea5-b5dd59a20885 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:30.638171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ba9b9a7a-563a-41d0-9ea5-b5dd59a20885 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152873 Jun 20 06:43:30.638731 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1049/2030] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:30 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:30.674721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-338755be-1a71-4de6-b38c-6990e822121c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:30.675358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-338755be-1a71-4de6-b38c-6990e822121c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:30.681837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-338755be-1a71-4de6-b38c-6990e822121c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:30.682284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-338755be-1a71-4de6-b38c-6990e822121c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:30.683035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-338755be-1a71-4de6-b38c-6990e822121c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:30.683481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-338755be-1a71-4de6-b38c-6990e822121c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:30.743677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-338755be-1a71-4de6-b38c-6990e822121c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:30.751322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-338755be-1a71-4de6-b38c-6990e822121c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080399 Jun 20 06:43:30.751893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 982/2031] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:30 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:31.656153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1ca42576-5d98-410c-8a65-325633f18cc0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:31.656770 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1ca42576-5d98-410c-8a65-325633f18cc0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:31.663215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ca42576-5d98-410c-8a65-325633f18cc0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:31.663659 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ca42576-5d98-410c-8a65-325633f18cc0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:31.664417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ca42576-5d98-410c-8a65-325633f18cc0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:31.664853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ca42576-5d98-410c-8a65-325633f18cc0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:31.668244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:31.768240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5de5e2b7-866b-4ce4-9fd0-1b5b6ee185c0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:31.768859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5de5e2b7-866b-4ce4-9fd0-1b5b6ee185c0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:31.775934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5de5e2b7-866b-4ce4-9fd0-1b5b6ee185c0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:31.776547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5de5e2b7-866b-4ce4-9fd0-1b5b6ee185c0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:31.777324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5de5e2b7-866b-4ce4-9fd0-1b5b6ee185c0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:31.777796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5de5e2b7-866b-4ce4-9fd0-1b5b6ee185c0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:31.795494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1ca42576-5d98-410c-8a65-325633f18cc0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:31.803331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1ca42576-5d98-410c-8a65-325633f18cc0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151218 Jun 20 06:43:31.803982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1050/2032] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:31 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:31.842750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5de5e2b7-866b-4ce4-9fd0-1b5b6ee185c0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:31.850258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5de5e2b7-866b-4ce4-9fd0-1b5b6ee185c0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085874 Jun 20 06:43:31.850828 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 983/2033] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:31 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:32.820064 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3b29851a-d100-46b3-865b-2336087220f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:32.820742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3b29851a-d100-46b3-865b-2336087220f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:32.827700 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b29851a-d100-46b3-865b-2336087220f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:32.828141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b29851a-d100-46b3-865b-2336087220f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:32.828896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b29851a-d100-46b3-865b-2336087220f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:32.829326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b29851a-d100-46b3-865b-2336087220f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:32.867355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-20636155-cb3f-4ac8-b400-ed081fe7c77b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:32.867962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-20636155-cb3f-4ac8-b400-ed081fe7c77b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:32.875507 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20636155-cb3f-4ac8-b400-ed081fe7c77b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:32.876199 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20636155-cb3f-4ac8-b400-ed081fe7c77b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:32.877391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20636155-cb3f-4ac8-b400-ed081fe7c77b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:32.878010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-20636155-cb3f-4ac8-b400-ed081fe7c77b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:32.952021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-20636155-cb3f-4ac8-b400-ed081fe7c77b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:32.959427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-20636155-cb3f-4ac8-b400-ed081fe7c77b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.095895 Jun 20 06:43:32.959986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 984/2034] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:32 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:32.981589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3b29851a-d100-46b3-865b-2336087220f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:32.989371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3b29851a-d100-46b3-865b-2336087220f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.173154 Jun 20 06:43:32.989946 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1051/2035] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:32 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:33.978616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9d83e2db-add3-4de2-824f-7dcaa731c449 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:33.983967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9d83e2db-add3-4de2-824f-7dcaa731c449 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:33.990779 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d83e2db-add3-4de2-824f-7dcaa731c449 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:33.991226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d83e2db-add3-4de2-824f-7dcaa731c449 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:33.992008 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d83e2db-add3-4de2-824f-7dcaa731c449 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:33.992442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9d83e2db-add3-4de2-824f-7dcaa731c449 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:34.006756 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fb9a83bf-da28-4bfa-b304-b238bf5b4b8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:34.007379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fb9a83bf-da28-4bfa-b304-b238bf5b4b8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:34.016625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb9a83bf-da28-4bfa-b304-b238bf5b4b8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:34.017068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb9a83bf-da28-4bfa-b304-b238bf5b4b8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:34.017882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb9a83bf-da28-4bfa-b304-b238bf5b4b8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:34.018321 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb9a83bf-da28-4bfa-b304-b238bf5b4b8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:34.073394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9d83e2db-add3-4de2-824f-7dcaa731c449 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:34.083460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9d83e2db-add3-4de2-824f-7dcaa731c449 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.110557 Jun 20 06:43:34.084046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 985/2036] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:33 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:34.181436 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fb9a83bf-da28-4bfa-b304-b238bf5b4b8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:34.190233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fb9a83bf-da28-4bfa-b304-b238bf5b4b8d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.187312 Jun 20 06:43:34.191805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1052/2037] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:34 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:35.100746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1b5d17b9-b724-4e88-a2c4-a158396e4b5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:35.101368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1b5d17b9-b724-4e88-a2c4-a158396e4b5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:35.108496 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b5d17b9-b724-4e88-a2c4-a158396e4b5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:35.108954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b5d17b9-b724-4e88-a2c4-a158396e4b5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:35.109751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b5d17b9-b724-4e88-a2c4-a158396e4b5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:35.110192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b5d17b9-b724-4e88-a2c4-a158396e4b5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:35.170691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b5d17b9-b724-4e88-a2c4-a158396e4b5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:35.178164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1b5d17b9-b724-4e88-a2c4-a158396e4b5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081295 Jun 20 06:43:35.178736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 986/2038] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:35 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:35.209405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e853b934-5044-4469-a3b7-8fa5a7b7ae0f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:35.209978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e853b934-5044-4469-a3b7-8fa5a7b7ae0f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:35.216519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e853b934-5044-4469-a3b7-8fa5a7b7ae0f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:35.216961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e853b934-5044-4469-a3b7-8fa5a7b7ae0f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:35.217730 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e853b934-5044-4469-a3b7-8fa5a7b7ae0f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:35.218162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e853b934-5044-4469-a3b7-8fa5a7b7ae0f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:35.348841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e853b934-5044-4469-a3b7-8fa5a7b7ae0f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:35.357368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e853b934-5044-4469-a3b7-8fa5a7b7ae0f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151888 Jun 20 06:43:35.357944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1053/2039] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:35 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:36.195654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6c0a82da-5855-490e-a3f3-199a71cd12eb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:36.196267 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6c0a82da-5855-490e-a3f3-199a71cd12eb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:36.203056 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c0a82da-5855-490e-a3f3-199a71cd12eb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:36.203503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c0a82da-5855-490e-a3f3-199a71cd12eb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:36.204268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c0a82da-5855-490e-a3f3-199a71cd12eb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:36.204701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c0a82da-5855-490e-a3f3-199a71cd12eb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:36.265515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6c0a82da-5855-490e-a3f3-199a71cd12eb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:36.272921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6c0a82da-5855-490e-a3f3-199a71cd12eb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081106 Jun 20 06:43:36.273491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 987/2040] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:36 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:36.374945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0bf4b10a-c126-483a-9050-3a352830acbb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:36.375551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0bf4b10a-c126-483a-9050-3a352830acbb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:36.382033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0bf4b10a-c126-483a-9050-3a352830acbb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:36.382473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0bf4b10a-c126-483a-9050-3a352830acbb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:36.383223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0bf4b10a-c126-483a-9050-3a352830acbb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:36.383652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0bf4b10a-c126-483a-9050-3a352830acbb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:36.514724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0bf4b10a-c126-483a-9050-3a352830acbb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:36.523516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0bf4b10a-c126-483a-9050-3a352830acbb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152400 Jun 20 06:43:36.524354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1054/2041] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:36 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:37.290197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c2a93f26-ad90-4eba-971e-5ff19fd0f012 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:37.291295 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c2a93f26-ad90-4eba-971e-5ff19fd0f012 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:37.297958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2a93f26-ad90-4eba-971e-5ff19fd0f012 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:37.298398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2a93f26-ad90-4eba-971e-5ff19fd0f012 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:37.299152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2a93f26-ad90-4eba-971e-5ff19fd0f012 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:37.299582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2a93f26-ad90-4eba-971e-5ff19fd0f012 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:37.360337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c2a93f26-ad90-4eba-971e-5ff19fd0f012 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:37.367837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c2a93f26-ad90-4eba-971e-5ff19fd0f012 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081565 Jun 20 06:43:37.368395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 988/2042] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:37 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:37.542823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f505a606-1eac-4ad4-a096-98cae7193fc8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:37.543449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f505a606-1eac-4ad4-a096-98cae7193fc8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:37.549864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f505a606-1eac-4ad4-a096-98cae7193fc8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:37.550292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f505a606-1eac-4ad4-a096-98cae7193fc8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:37.551044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f505a606-1eac-4ad4-a096-98cae7193fc8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:37.551469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f505a606-1eac-4ad4-a096-98cae7193fc8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:37.681257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f505a606-1eac-4ad4-a096-98cae7193fc8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:37.688987 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f505a606-1eac-4ad4-a096-98cae7193fc8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151031 Jun 20 06:43:37.689569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1055/2043] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:37 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:38.385974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1e2c9d9a-b1df-4a5e-bd3c-83caeb0d4eb5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:38.386588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1e2c9d9a-b1df-4a5e-bd3c-83caeb0d4eb5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:38.393441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e2c9d9a-b1df-4a5e-bd3c-83caeb0d4eb5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:38.393894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e2c9d9a-b1df-4a5e-bd3c-83caeb0d4eb5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:38.394644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e2c9d9a-b1df-4a5e-bd3c-83caeb0d4eb5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:38.395075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e2c9d9a-b1df-4a5e-bd3c-83caeb0d4eb5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:38.455608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1e2c9d9a-b1df-4a5e-bd3c-83caeb0d4eb5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:38.462948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1e2c9d9a-b1df-4a5e-bd3c-83caeb0d4eb5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081493 Jun 20 06:43:38.463498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 989/2044] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:38 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:38.706057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7587aeaa-4b08-4e05-b138-55c263b71250 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:38.706677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7587aeaa-4b08-4e05-b138-55c263b71250 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:38.713340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7587aeaa-4b08-4e05-b138-55c263b71250 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:38.713823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7587aeaa-4b08-4e05-b138-55c263b71250 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:38.714603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7587aeaa-4b08-4e05-b138-55c263b71250 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:38.715040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7587aeaa-4b08-4e05-b138-55c263b71250 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:38.846303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7587aeaa-4b08-4e05-b138-55c263b71250 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:38.854706 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7587aeaa-4b08-4e05-b138-55c263b71250 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152536 Jun 20 06:43:38.855267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1056/2045] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:38 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:39.479696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f44d0590-824c-43db-8d33-d2ab20031c00 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:39.480305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f44d0590-824c-43db-8d33-d2ab20031c00 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:39.486887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f44d0590-824c-43db-8d33-d2ab20031c00 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:39.487327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f44d0590-824c-43db-8d33-d2ab20031c00 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:39.488080 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f44d0590-824c-43db-8d33-d2ab20031c00 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:39.488510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f44d0590-824c-43db-8d33-d2ab20031c00 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:39.549909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f44d0590-824c-43db-8d33-d2ab20031c00 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:39.558180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f44d0590-824c-43db-8d33-d2ab20031c00 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082442 Jun 20 06:43:39.558754 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 990/2046] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:39 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:39.872143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2369a14f-0886-43d3-a554-08df924851e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:39.872696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2369a14f-0886-43d3-a554-08df924851e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:39.879156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2369a14f-0886-43d3-a554-08df924851e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:39.879603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2369a14f-0886-43d3-a554-08df924851e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:39.880371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2369a14f-0886-43d3-a554-08df924851e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:39.880807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2369a14f-0886-43d3-a554-08df924851e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:40.006073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2369a14f-0886-43d3-a554-08df924851e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:40.014233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2369a14f-0886-43d3-a554-08df924851e9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146335 Jun 20 06:43:40.014800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1057/2047] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:39 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:40.576110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f9be4a64-316c-4f66-87b7-f02da72cc1e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:40.576721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f9be4a64-316c-4f66-87b7-f02da72cc1e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:40.583449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9be4a64-316c-4f66-87b7-f02da72cc1e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:40.583833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9be4a64-316c-4f66-87b7-f02da72cc1e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:40.584594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9be4a64-316c-4f66-87b7-f02da72cc1e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:40.585025 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9be4a64-316c-4f66-87b7-f02da72cc1e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:40.648095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f9be4a64-316c-4f66-87b7-f02da72cc1e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:40.655743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f9be4a64-316c-4f66-87b7-f02da72cc1e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084251 Jun 20 06:43:40.656304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 991/2048] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:40 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:41.031211 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db6d2045-ace8-456c-bd84-6956f7f4c56f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:41.031823 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-db6d2045-ace8-456c-bd84-6956f7f4c56f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:41.038349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db6d2045-ace8-456c-bd84-6956f7f4c56f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:41.038799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db6d2045-ace8-456c-bd84-6956f7f4c56f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:41.039556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db6d2045-ace8-456c-bd84-6956f7f4c56f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:41.039993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db6d2045-ace8-456c-bd84-6956f7f4c56f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:41.170243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-db6d2045-ace8-456c-bd84-6956f7f4c56f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:41.178201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-db6d2045-ace8-456c-bd84-6956f7f4c56f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150843 Jun 20 06:43:41.178762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1058/2049] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:41 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:41.673196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8f5a7dbd-e9a3-472b-bf3a-7316c6ceb722 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:41.673859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8f5a7dbd-e9a3-472b-bf3a-7316c6ceb722 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:41.680273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f5a7dbd-e9a3-472b-bf3a-7316c6ceb722 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:41.680717 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f5a7dbd-e9a3-472b-bf3a-7316c6ceb722 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:41.681497 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f5a7dbd-e9a3-472b-bf3a-7316c6ceb722 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:41.681958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f5a7dbd-e9a3-472b-bf3a-7316c6ceb722 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:41.742651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8f5a7dbd-e9a3-472b-bf3a-7316c6ceb722 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:41.750360 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8f5a7dbd-e9a3-472b-bf3a-7316c6ceb722 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081043 Jun 20 06:43:41.750924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 992/2050] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:41 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:42.195172 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-483b3a8f-6849-44f8-9578-492ba4b6556f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:42.195772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-483b3a8f-6849-44f8-9578-492ba4b6556f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:42.202774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-483b3a8f-6849-44f8-9578-492ba4b6556f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:42.203166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-483b3a8f-6849-44f8-9578-492ba4b6556f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:42.203915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-483b3a8f-6849-44f8-9578-492ba4b6556f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:42.204344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-483b3a8f-6849-44f8-9578-492ba4b6556f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:42.332486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-483b3a8f-6849-44f8-9578-492ba4b6556f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:42.340962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-483b3a8f-6849-44f8-9578-492ba4b6556f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149605 Jun 20 06:43:42.341543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1059/2051] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:42 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:42.767517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-54471b5c-6e66-4bb1-b82b-445bd8c76758 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:42.768107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54471b5c-6e66-4bb1-b82b-445bd8c76758 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:42.774505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54471b5c-6e66-4bb1-b82b-445bd8c76758 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:42.774968 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54471b5c-6e66-4bb1-b82b-445bd8c76758 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:42.776443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54471b5c-6e66-4bb1-b82b-445bd8c76758 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:42.776876 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54471b5c-6e66-4bb1-b82b-445bd8c76758 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:42.779371 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:42.837422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-54471b5c-6e66-4bb1-b82b-445bd8c76758 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:42.844826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-54471b5c-6e66-4bb1-b82b-445bd8c76758 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081204 Jun 20 06:43:42.845414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 993/2052] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:42 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:43.358486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-073b74bb-2ccf-4908-96c0-de510032eb23 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:43.359138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-073b74bb-2ccf-4908-96c0-de510032eb23 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:43.365649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-073b74bb-2ccf-4908-96c0-de510032eb23 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:43.366092 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-073b74bb-2ccf-4908-96c0-de510032eb23 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:43.366847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-073b74bb-2ccf-4908-96c0-de510032eb23 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:43.367279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-073b74bb-2ccf-4908-96c0-de510032eb23 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:43.493042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-073b74bb-2ccf-4908-96c0-de510032eb23 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:43.501530 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-073b74bb-2ccf-4908-96c0-de510032eb23 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146886 Jun 20 06:43:43.502098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1060/2053] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:43 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:43.861372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-35bfd018-3713-43f7-ab98-34cd3a94e1ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:43.862005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-35bfd018-3713-43f7-ab98-34cd3a94e1ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:43.868501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35bfd018-3713-43f7-ab98-34cd3a94e1ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:43.868980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35bfd018-3713-43f7-ab98-34cd3a94e1ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:43.869952 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35bfd018-3713-43f7-ab98-34cd3a94e1ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:43.870389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35bfd018-3713-43f7-ab98-34cd3a94e1ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:43.931337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-35bfd018-3713-43f7-ab98-34cd3a94e1ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:43.938825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-35bfd018-3713-43f7-ab98-34cd3a94e1ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081282 Jun 20 06:43:43.939382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 994/2054] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:43 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:44.519004 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0fab6798-fc5c-4de6-b24a-ea9f0d1f2047 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:44.519642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0fab6798-fc5c-4de6-b24a-ea9f0d1f2047 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:44.526781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fab6798-fc5c-4de6-b24a-ea9f0d1f2047 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:44.527223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fab6798-fc5c-4de6-b24a-ea9f0d1f2047 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:44.527984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fab6798-fc5c-4de6-b24a-ea9f0d1f2047 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:44.528418 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fab6798-fc5c-4de6-b24a-ea9f0d1f2047 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:44.660130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0fab6798-fc5c-4de6-b24a-ea9f0d1f2047 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:44.668736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0fab6798-fc5c-4de6-b24a-ea9f0d1f2047 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153614 Jun 20 06:43:44.669298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1061/2055] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:44 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:44.955998 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b9357f03-581c-4881-810c-33e4c80768ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:44.956668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b9357f03-581c-4881-810c-33e4c80768ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:44.958567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:44.964070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9357f03-581c-4881-810c-33e4c80768ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:44.964525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9357f03-581c-4881-810c-33e4c80768ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:44.965297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9357f03-581c-4881-810c-33e4c80768ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:44.965835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b9357f03-581c-4881-810c-33e4c80768ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:45.035362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b9357f03-581c-4881-810c-33e4c80768ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:45.044079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b9357f03-581c-4881-810c-33e4c80768ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.092016 Jun 20 06:43:45.044677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 995/2056] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:44 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:45.685603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea8cd4da-e449-4e88-9f2e-41514a6fced5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:45.686205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ea8cd4da-e449-4e88-9f2e-41514a6fced5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:45.687978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:45.693784 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea8cd4da-e449-4e88-9f2e-41514a6fced5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:45.694226 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea8cd4da-e449-4e88-9f2e-41514a6fced5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:45.695034 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea8cd4da-e449-4e88-9f2e-41514a6fced5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:45.695462 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea8cd4da-e449-4e88-9f2e-41514a6fced5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:45.827011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ea8cd4da-e449-4e88-9f2e-41514a6fced5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:45.834934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ea8cd4da-e449-4e88-9f2e-41514a6fced5 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153579 Jun 20 06:43:45.835506 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1062/2057] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:45 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:46.060938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e6d68af8-4e6c-4528-b37f-02fbb2a9c3b4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:46.061512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e6d68af8-4e6c-4528-b37f-02fbb2a9c3b4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:46.067887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6d68af8-4e6c-4528-b37f-02fbb2a9c3b4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:46.068332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6d68af8-4e6c-4528-b37f-02fbb2a9c3b4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:46.069088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6d68af8-4e6c-4528-b37f-02fbb2a9c3b4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:46.069554 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6d68af8-4e6c-4528-b37f-02fbb2a9c3b4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:46.130726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6d68af8-4e6c-4528-b37f-02fbb2a9c3b4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:46.139206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e6d68af8-4e6c-4528-b37f-02fbb2a9c3b4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082881 Jun 20 06:43:46.139769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 996/2058] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:46 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:46.852181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d0a34336-d8d4-4a73-8952-39d4e5b5a220 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:46.852785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d0a34336-d8d4-4a73-8952-39d4e5b5a220 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:46.859929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0a34336-d8d4-4a73-8952-39d4e5b5a220 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:46.860369 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0a34336-d8d4-4a73-8952-39d4e5b5a220 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:46.861111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0a34336-d8d4-4a73-8952-39d4e5b5a220 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:46.861572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0a34336-d8d4-4a73-8952-39d4e5b5a220 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:46.985289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d0a34336-d8d4-4a73-8952-39d4e5b5a220 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:46.993163 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d0a34336-d8d4-4a73-8952-39d4e5b5a220 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.144958 Jun 20 06:43:46.993750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1063/2059] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:46 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:47.156618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d4691b97-39e1-4285-bb88-1afa3bf1b6df tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:47.157235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d4691b97-39e1-4285-bb88-1afa3bf1b6df tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:47.163845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4691b97-39e1-4285-bb88-1afa3bf1b6df tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:47.164280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4691b97-39e1-4285-bb88-1afa3bf1b6df tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:47.165040 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4691b97-39e1-4285-bb88-1afa3bf1b6df tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:47.165514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d4691b97-39e1-4285-bb88-1afa3bf1b6df tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:47.226470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d4691b97-39e1-4285-bb88-1afa3bf1b6df tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:47.234020 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d4691b97-39e1-4285-bb88-1afa3bf1b6df tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081266 Jun 20 06:43:47.234832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 997/2060] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:47 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:48.010997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-48c126f5-5dc4-41f2-9813-e3d6b6aa9423 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:48.011600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-48c126f5-5dc4-41f2-9813-e3d6b6aa9423 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:48.018242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48c126f5-5dc4-41f2-9813-e3d6b6aa9423 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:48.018680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48c126f5-5dc4-41f2-9813-e3d6b6aa9423 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:48.019437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48c126f5-5dc4-41f2-9813-e3d6b6aa9423 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:48.019865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48c126f5-5dc4-41f2-9813-e3d6b6aa9423 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:48.148884 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-48c126f5-5dc4-41f2-9813-e3d6b6aa9423 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:48.156683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-48c126f5-5dc4-41f2-9813-e3d6b6aa9423 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150097 Jun 20 06:43:48.157244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1064/2061] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:48 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:48.250835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f9c679e1-c5e6-4063-89c5-7480205ad3ea tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:48.251444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f9c679e1-c5e6-4063-89c5-7480205ad3ea tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:48.257898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9c679e1-c5e6-4063-89c5-7480205ad3ea tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:48.258342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9c679e1-c5e6-4063-89c5-7480205ad3ea tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:48.259096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9c679e1-c5e6-4063-89c5-7480205ad3ea tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:48.260121 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f9c679e1-c5e6-4063-89c5-7480205ad3ea tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:48.323795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f9c679e1-c5e6-4063-89c5-7480205ad3ea tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:48.331391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f9c679e1-c5e6-4063-89c5-7480205ad3ea tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084410 Jun 20 06:43:48.331956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 998/2062] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:48 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:49.173639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4e72beb2-45a1-4bf2-9b1d-efd7da85acdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:49.174233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4e72beb2-45a1-4bf2-9b1d-efd7da85acdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:49.180496 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e72beb2-45a1-4bf2-9b1d-efd7da85acdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:49.180945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e72beb2-45a1-4bf2-9b1d-efd7da85acdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:49.181764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e72beb2-45a1-4bf2-9b1d-efd7da85acdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:49.182192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e72beb2-45a1-4bf2-9b1d-efd7da85acdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:49.315231 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4e72beb2-45a1-4bf2-9b1d-efd7da85acdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:49.324312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4e72beb2-45a1-4bf2-9b1d-efd7da85acdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.154493 Jun 20 06:43:49.324912 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1065/2063] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:49 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:49.347913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0ec62384-a721-4f88-a498-92504081a426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:49.348664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0ec62384-a721-4f88-a498-92504081a426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:49.355871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ec62384-a721-4f88-a498-92504081a426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:49.356317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ec62384-a721-4f88-a498-92504081a426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:49.357081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ec62384-a721-4f88-a498-92504081a426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:49.357545 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ec62384-a721-4f88-a498-92504081a426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:49.418402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0ec62384-a721-4f88-a498-92504081a426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:49.425768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0ec62384-a721-4f88-a498-92504081a426 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081695 Jun 20 06:43:49.426338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 999/2064] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:49 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:50.341174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-592759ce-3e3b-4efd-bb38-146be85c0799 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:50.341806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-592759ce-3e3b-4efd-bb38-146be85c0799 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:50.348606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-592759ce-3e3b-4efd-bb38-146be85c0799 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:50.349043 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-592759ce-3e3b-4efd-bb38-146be85c0799 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:50.349828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-592759ce-3e3b-4efd-bb38-146be85c0799 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:50.350259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-592759ce-3e3b-4efd-bb38-146be85c0799 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:50.442994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-074b145f-e794-44d3-8b23-c572edd25650 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:50.443721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-074b145f-e794-44d3-8b23-c572edd25650 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:50.450311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-074b145f-e794-44d3-8b23-c572edd25650 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:50.450840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-074b145f-e794-44d3-8b23-c572edd25650 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:50.451680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-074b145f-e794-44d3-8b23-c572edd25650 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:50.452126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-074b145f-e794-44d3-8b23-c572edd25650 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:50.479291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-592759ce-3e3b-4efd-bb38-146be85c0799 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:50.481488 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:43:50.488546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-592759ce-3e3b-4efd-bb38-146be85c0799 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151720 Jun 20 06:43:50.489116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1066/2065] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:50 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:50.513023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-074b145f-e794-44d3-8b23-c572edd25650 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:50.520505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-074b145f-e794-44d3-8b23-c572edd25650 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081398 Jun 20 06:43:50.521066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1000/2066] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:50 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:51.505892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a97ab25b-65d1-42a8-855b-cd782024bcf0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:51.506534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a97ab25b-65d1-42a8-855b-cd782024bcf0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:51.513428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a97ab25b-65d1-42a8-855b-cd782024bcf0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:51.513875 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a97ab25b-65d1-42a8-855b-cd782024bcf0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:51.514640 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a97ab25b-65d1-42a8-855b-cd782024bcf0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:51.515106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a97ab25b-65d1-42a8-855b-cd782024bcf0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:51.537197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d58995b1-d3c7-499e-995a-dafcaf671237 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:51.537829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d58995b1-d3c7-499e-995a-dafcaf671237 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:51.544746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d58995b1-d3c7-499e-995a-dafcaf671237 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:51.545191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d58995b1-d3c7-499e-995a-dafcaf671237 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:51.545984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d58995b1-d3c7-499e-995a-dafcaf671237 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:51.546419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d58995b1-d3c7-499e-995a-dafcaf671237 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:51.617568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d58995b1-d3c7-499e-995a-dafcaf671237 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:51.625639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d58995b1-d3c7-499e-995a-dafcaf671237 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.092218 Jun 20 06:43:51.626223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1001/2067] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:51 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:51.677206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a97ab25b-65d1-42a8-855b-cd782024bcf0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:51.685832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a97ab25b-65d1-42a8-855b-cd782024bcf0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.183962 Jun 20 06:43:51.686398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1067/2068] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:51 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:52.642129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-80edeeab-21fc-4936-bfe4-90c18080313f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:52.642741 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-80edeeab-21fc-4936-bfe4-90c18080313f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:52.649179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80edeeab-21fc-4936-bfe4-90c18080313f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:52.649668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80edeeab-21fc-4936-bfe4-90c18080313f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:52.651556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80edeeab-21fc-4936-bfe4-90c18080313f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:52.652000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80edeeab-21fc-4936-bfe4-90c18080313f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:52.703857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8aec8d69-cbb1-448b-b03d-77392f197d41 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:52.704472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8aec8d69-cbb1-448b-b03d-77392f197d41 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:52.710847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aec8d69-cbb1-448b-b03d-77392f197d41 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:52.711615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aec8d69-cbb1-448b-b03d-77392f197d41 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:52.712046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aec8d69-cbb1-448b-b03d-77392f197d41 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:52.713025 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aec8d69-cbb1-448b-b03d-77392f197d41 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:52.714318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-80edeeab-21fc-4936-bfe4-90c18080313f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:52.722057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-80edeeab-21fc-4936-bfe4-90c18080313f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083839 Jun 20 06:43:52.722620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1002/2069] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:52 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:52.844920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8aec8d69-cbb1-448b-b03d-77392f197d41 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:52.852720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8aec8d69-cbb1-448b-b03d-77392f197d41 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152693 Jun 20 06:43:52.853895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1068/2070] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:52 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:43:53.739674 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aee0ba6f-f6c8-4fec-bce2-94d92b0c04c8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:53.740284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aee0ba6f-f6c8-4fec-bce2-94d92b0c04c8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:53.748249 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aee0ba6f-f6c8-4fec-bce2-94d92b0c04c8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:53.748697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aee0ba6f-f6c8-4fec-bce2-94d92b0c04c8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:53.749489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aee0ba6f-f6c8-4fec-bce2-94d92b0c04c8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:53.749927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aee0ba6f-f6c8-4fec-bce2-94d92b0c04c8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:53.810788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-aee0ba6f-f6c8-4fec-bce2-94d92b0c04c8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:53.818147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aee0ba6f-f6c8-4fec-bce2-94d92b0c04c8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082321 Jun 20 06:43:53.818708 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1003/2071] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:53 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:53.870852 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4b05bab4-6206-4d01-bbae-dbd3cc3b69fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:53.871470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4b05bab4-6206-4d01-bbae-dbd3cc3b69fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:53.877933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b05bab4-6206-4d01-bbae-dbd3cc3b69fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:53.878384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b05bab4-6206-4d01-bbae-dbd3cc3b69fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:53.879147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b05bab4-6206-4d01-bbae-dbd3cc3b69fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:53.879583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b05bab4-6206-4d01-bbae-dbd3cc3b69fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:54.006445 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4b05bab4-6206-4d01-bbae-dbd3cc3b69fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:54.015124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4b05bab4-6206-4d01-bbae-dbd3cc3b69fa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148849 Jun 20 06:43:54.015689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1069/2072] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:53 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:54.834151 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-51b125a5-979e-47f5-9070-acae02381887 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:54.834742 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-51b125a5-979e-47f5-9070-acae02381887 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:54.841484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51b125a5-979e-47f5-9070-acae02381887 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:54.841933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51b125a5-979e-47f5-9070-acae02381887 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:54.842687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51b125a5-979e-47f5-9070-acae02381887 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:54.843119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51b125a5-979e-47f5-9070-acae02381887 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:54.909128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-51b125a5-979e-47f5-9070-acae02381887 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:54.916699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-51b125a5-979e-47f5-9070-acae02381887 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086375 Jun 20 06:43:54.917272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1004/2073] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:54 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:55.036112 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57396ae6-110b-47c9-ad58-65edbe10ab7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:55.037257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-57396ae6-110b-47c9-ad58-65edbe10ab7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:55.044931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57396ae6-110b-47c9-ad58-65edbe10ab7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:55.045401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57396ae6-110b-47c9-ad58-65edbe10ab7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:55.046194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57396ae6-110b-47c9-ad58-65edbe10ab7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:55.046634 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57396ae6-110b-47c9-ad58-65edbe10ab7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:55.172159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-57396ae6-110b-47c9-ad58-65edbe10ab7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:55.180024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-57396ae6-110b-47c9-ad58-65edbe10ab7d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.151251 Jun 20 06:43:55.180615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1070/2074] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:55 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:55.934473 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e0edb525-430e-4931-8e0f-488d98fbc828 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:55.935068 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e0edb525-430e-4931-8e0f-488d98fbc828 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:55.941618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0edb525-430e-4931-8e0f-488d98fbc828 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:55.942069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0edb525-430e-4931-8e0f-488d98fbc828 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:55.942832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0edb525-430e-4931-8e0f-488d98fbc828 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:55.943266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0edb525-430e-4931-8e0f-488d98fbc828 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:56.003272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e0edb525-430e-4931-8e0f-488d98fbc828 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:56.011004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e0edb525-430e-4931-8e0f-488d98fbc828 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081596 Jun 20 06:43:56.011561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1005/2075] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:55 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:56.197585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2241c3aa-5b6d-48ca-a5a4-76022293cebb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:56.198196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2241c3aa-5b6d-48ca-a5a4-76022293cebb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:56.204539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2241c3aa-5b6d-48ca-a5a4-76022293cebb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:56.204978 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2241c3aa-5b6d-48ca-a5a4-76022293cebb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:56.205754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2241c3aa-5b6d-48ca-a5a4-76022293cebb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:56.206181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2241c3aa-5b6d-48ca-a5a4-76022293cebb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:56.337454 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2241c3aa-5b6d-48ca-a5a4-76022293cebb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:56.345950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2241c3aa-5b6d-48ca-a5a4-76022293cebb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152774 Jun 20 06:43:56.346511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1071/2076] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:56 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:57.028454 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5bcae69d-0998-40fa-aaed-9699b67f620d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:57.029058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5bcae69d-0998-40fa-aaed-9699b67f620d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:57.035486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bcae69d-0998-40fa-aaed-9699b67f620d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:57.035931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bcae69d-0998-40fa-aaed-9699b67f620d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:57.036679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bcae69d-0998-40fa-aaed-9699b67f620d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:57.037135 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bcae69d-0998-40fa-aaed-9699b67f620d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:57.097723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5bcae69d-0998-40fa-aaed-9699b67f620d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:57.105339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5bcae69d-0998-40fa-aaed-9699b67f620d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081460 Jun 20 06:43:57.105923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1006/2077] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:57 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:57.362733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d05f67d3-c6c0-41c7-85e3-8d55ea012a95 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:57.363338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d05f67d3-c6c0-41c7-85e3-8d55ea012a95 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:57.370944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d05f67d3-c6c0-41c7-85e3-8d55ea012a95 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:57.371512 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d05f67d3-c6c0-41c7-85e3-8d55ea012a95 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:57.372268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d05f67d3-c6c0-41c7-85e3-8d55ea012a95 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:57.372698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d05f67d3-c6c0-41c7-85e3-8d55ea012a95 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:57.497980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d05f67d3-c6c0-41c7-85e3-8d55ea012a95 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:57.505883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d05f67d3-c6c0-41c7-85e3-8d55ea012a95 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.146968 Jun 20 06:43:57.506447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1072/2078] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:57 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:58.122225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-efa5000c-d07a-4be7-b4c5-76b9ee06ae8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:58.122780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-efa5000c-d07a-4be7-b4c5-76b9ee06ae8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:58.129142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efa5000c-d07a-4be7-b4c5-76b9ee06ae8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:58.129618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efa5000c-d07a-4be7-b4c5-76b9ee06ae8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:58.130375 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efa5000c-d07a-4be7-b4c5-76b9ee06ae8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:58.130814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-efa5000c-d07a-4be7-b4c5-76b9ee06ae8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:58.194041 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-efa5000c-d07a-4be7-b4c5-76b9ee06ae8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:58.201985 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-efa5000c-d07a-4be7-b4c5-76b9ee06ae8c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083958 Jun 20 06:43:58.202544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1007/2079] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:58 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:58.523218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-54ec231b-71bd-47dd-ae83-16d54ca4e69e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:58.523835 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-54ec231b-71bd-47dd-ae83-16d54ca4e69e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:58.531077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54ec231b-71bd-47dd-ae83-16d54ca4e69e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:58.531529 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54ec231b-71bd-47dd-ae83-16d54ca4e69e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:58.532359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54ec231b-71bd-47dd-ae83-16d54ca4e69e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:58.532801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54ec231b-71bd-47dd-ae83-16d54ca4e69e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:58.663391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-54ec231b-71bd-47dd-ae83-16d54ca4e69e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:58.672339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-54ec231b-71bd-47dd-ae83-16d54ca4e69e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153058 Jun 20 06:43:58.672901 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1073/2080] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:58 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:59.219713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40cab7f8-bcff-4c54-a123-a841f1239107 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:59.220261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40cab7f8-bcff-4c54-a123-a841f1239107 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:59.226668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40cab7f8-bcff-4c54-a123-a841f1239107 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:59.227115 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40cab7f8-bcff-4c54-a123-a841f1239107 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:59.227869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40cab7f8-bcff-4c54-a123-a841f1239107 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:59.228372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40cab7f8-bcff-4c54-a123-a841f1239107 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:59.288696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40cab7f8-bcff-4c54-a123-a841f1239107 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:59.296477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40cab7f8-bcff-4c54-a123-a841f1239107 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080717 Jun 20 06:43:59.297046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1008/2081] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:59 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:43:59.689016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-acf4cc15-fd04-4b3d-889c-7d173db22bd3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:43:59.689655 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-acf4cc15-fd04-4b3d-889c-7d173db22bd3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:43:59.696133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-acf4cc15-fd04-4b3d-889c-7d173db22bd3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:59.696591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-acf4cc15-fd04-4b3d-889c-7d173db22bd3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:59.697495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-acf4cc15-fd04-4b3d-889c-7d173db22bd3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:43:59.697938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-acf4cc15-fd04-4b3d-889c-7d173db22bd3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:43:59.829749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-acf4cc15-fd04-4b3d-889c-7d173db22bd3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:43:59.838185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-acf4cc15-fd04-4b3d-889c-7d173db22bd3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.152288 Jun 20 06:43:59.838747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1074/2082] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:43:59 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:00.313302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1e02ee6a-d7d4-4fa6-adee-9164feb7ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:00.313936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1e02ee6a-d7d4-4fa6-adee-9164feb7ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:00.320481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e02ee6a-d7d4-4fa6-adee-9164feb7ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:00.321087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e02ee6a-d7d4-4fa6-adee-9164feb7ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:00.322669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e02ee6a-d7d4-4fa6-adee-9164feb7ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:00.323106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1e02ee6a-d7d4-4fa6-adee-9164feb7ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:00.382973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1e02ee6a-d7d4-4fa6-adee-9164feb7ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:00.386093 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:00.393403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1e02ee6a-d7d4-4fa6-adee-9164feb7ceee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083911 Jun 20 06:44:00.393988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1009/2083] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:00 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:00.855741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fdf3e857-683f-45af-9e00-ad2c08f2b714 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:00.856326 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fdf3e857-683f-45af-9e00-ad2c08f2b714 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:00.862847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdf3e857-683f-45af-9e00-ad2c08f2b714 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:00.863242 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdf3e857-683f-45af-9e00-ad2c08f2b714 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:00.864006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdf3e857-683f-45af-9e00-ad2c08f2b714 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:00.864442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fdf3e857-683f-45af-9e00-ad2c08f2b714 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:00.990999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fdf3e857-683f-45af-9e00-ad2c08f2b714 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:00.999144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fdf3e857-683f-45af-9e00-ad2c08f2b714 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148118 Jun 20 06:44:00.999709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1075/2084] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:00 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:01.410444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a392831e-eca5-4d15-9f87-3ec82143df10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:01.411058 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a392831e-eca5-4d15-9f87-3ec82143df10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:01.418043 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a392831e-eca5-4d15-9f87-3ec82143df10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:01.418493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a392831e-eca5-4d15-9f87-3ec82143df10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:01.419254 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a392831e-eca5-4d15-9f87-3ec82143df10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:01.419694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a392831e-eca5-4d15-9f87-3ec82143df10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:01.482776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a392831e-eca5-4d15-9f87-3ec82143df10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:01.490219 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a392831e-eca5-4d15-9f87-3ec82143df10 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083672 Jun 20 06:44:01.490776 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1010/2085] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:01 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:02.016245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0f45a352-fbac-461d-98b4-79cde53e8d0a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:02.016934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0f45a352-fbac-461d-98b4-79cde53e8d0a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:02.023279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f45a352-fbac-461d-98b4-79cde53e8d0a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:02.023729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f45a352-fbac-461d-98b4-79cde53e8d0a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:02.024475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f45a352-fbac-461d-98b4-79cde53e8d0a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:02.025155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f45a352-fbac-461d-98b4-79cde53e8d0a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:02.388266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0f45a352-fbac-461d-98b4-79cde53e8d0a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:02.396637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0f45a352-fbac-461d-98b4-79cde53e8d0a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.384503 Jun 20 06:44:02.397191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1076/2086] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:02 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:02.507188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c0d7f11-b48a-40be-b4f8-ccfcdc00f21e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:02.507805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c0d7f11-b48a-40be-b4f8-ccfcdc00f21e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:02.514885 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c0d7f11-b48a-40be-b4f8-ccfcdc00f21e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:02.515334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c0d7f11-b48a-40be-b4f8-ccfcdc00f21e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:02.516104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c0d7f11-b48a-40be-b4f8-ccfcdc00f21e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:02.516539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c0d7f11-b48a-40be-b4f8-ccfcdc00f21e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:02.579762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c0d7f11-b48a-40be-b4f8-ccfcdc00f21e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:02.587817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c0d7f11-b48a-40be-b4f8-ccfcdc00f21e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083911 Jun 20 06:44:02.588320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1011/2087] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:02 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:03.414268 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a3d3adee-07f0-4eb2-922a-3ee278429749 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:03.414867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a3d3adee-07f0-4eb2-922a-3ee278429749 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:03.421534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3d3adee-07f0-4eb2-922a-3ee278429749 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:03.421989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3d3adee-07f0-4eb2-922a-3ee278429749 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:03.422749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3d3adee-07f0-4eb2-922a-3ee278429749 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:03.423187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a3d3adee-07f0-4eb2-922a-3ee278429749 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:03.551341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a3d3adee-07f0-4eb2-922a-3ee278429749 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:03.561412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a3d3adee-07f0-4eb2-922a-3ee278429749 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.150754 Jun 20 06:44:03.562505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1077/2088] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:03 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:03.605186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9ff0e7e2-118b-49e4-8928-0da39adac929 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:03.605751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9ff0e7e2-118b-49e4-8928-0da39adac929 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:03.612183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ff0e7e2-118b-49e4-8928-0da39adac929 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:03.612632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ff0e7e2-118b-49e4-8928-0da39adac929 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:03.613394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ff0e7e2-118b-49e4-8928-0da39adac929 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:03.613840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ff0e7e2-118b-49e4-8928-0da39adac929 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:03.674022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9ff0e7e2-118b-49e4-8928-0da39adac929 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:03.682117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9ff0e7e2-118b-49e4-8928-0da39adac929 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081529 Jun 20 06:44:03.682678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1012/2089] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:03 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:04.579107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-39e8d11b-e50a-4012-85bd-e088950c2ceb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:04.579758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-39e8d11b-e50a-4012-85bd-e088950c2ceb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:04.586328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39e8d11b-e50a-4012-85bd-e088950c2ceb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:04.586722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39e8d11b-e50a-4012-85bd-e088950c2ceb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:04.587540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39e8d11b-e50a-4012-85bd-e088950c2ceb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:04.588152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-39e8d11b-e50a-4012-85bd-e088950c2ceb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:04.699241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-182782fb-7820-4af7-aa91-594f50c9d038 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:04.699835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-182782fb-7820-4af7-aa91-594f50c9d038 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:04.706322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-182782fb-7820-4af7-aa91-594f50c9d038 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:04.706772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-182782fb-7820-4af7-aa91-594f50c9d038 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:04.707536 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-182782fb-7820-4af7-aa91-594f50c9d038 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:04.707975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-182782fb-7820-4af7-aa91-594f50c9d038 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:04.715095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-39e8d11b-e50a-4012-85bd-e088950c2ceb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:04.722932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-39e8d11b-e50a-4012-85bd-e088950c2ceb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.147718 Jun 20 06:44:04.723502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1078/2090] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:04 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:04.776232 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-182782fb-7820-4af7-aa91-594f50c9d038 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:04.783735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-182782fb-7820-4af7-aa91-594f50c9d038 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.088944 Jun 20 06:44:04.784305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1013/2091] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:04 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:44:05.740614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a537650-f0ce-4490-b895-3fd4ed7e8524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:05.741213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2a537650-f0ce-4490-b895-3fd4ed7e8524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:05.748225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a537650-f0ce-4490-b895-3fd4ed7e8524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:05.748667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a537650-f0ce-4490-b895-3fd4ed7e8524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:05.749436 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a537650-f0ce-4490-b895-3fd4ed7e8524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:05.749876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a537650-f0ce-4490-b895-3fd4ed7e8524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:05.801398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-603a01d3-4bbc-473c-9dbf-e99754833087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:05.802038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-603a01d3-4bbc-473c-9dbf-e99754833087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:05.809731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-603a01d3-4bbc-473c-9dbf-e99754833087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:05.810189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-603a01d3-4bbc-473c-9dbf-e99754833087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:05.810959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-603a01d3-4bbc-473c-9dbf-e99754833087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:05.811394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-603a01d3-4bbc-473c-9dbf-e99754833087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:05.878801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-603a01d3-4bbc-473c-9dbf-e99754833087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:05.887853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-603a01d3-4bbc-473c-9dbf-e99754833087 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.090099 Jun 20 06:44:05.888430 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1014/2092] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:05 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:44:05.900672 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2a537650-f0ce-4490-b895-3fd4ed7e8524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:05.908599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2a537650-f0ce-4490-b895-3fd4ed7e8524 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.171833 Jun 20 06:44:05.909229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1079/2093] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:05 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:06.904713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2872dfe7-94a0-443f-9c31-cf5ea5e6213b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:06.905343 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2872dfe7-94a0-443f-9c31-cf5ea5e6213b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:06.911796 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2872dfe7-94a0-443f-9c31-cf5ea5e6213b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:06.912243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2872dfe7-94a0-443f-9c31-cf5ea5e6213b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:06.913002 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2872dfe7-94a0-443f-9c31-cf5ea5e6213b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:06.913462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2872dfe7-94a0-443f-9c31-cf5ea5e6213b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:06.925181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3751e90b-ab9d-4cd6-a9e8-e9145579bb9f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:06.925820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3751e90b-ab9d-4cd6-a9e8-e9145579bb9f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:06.931953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3751e90b-ab9d-4cd6-a9e8-e9145579bb9f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:06.932958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3751e90b-ab9d-4cd6-a9e8-e9145579bb9f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:06.933754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3751e90b-ab9d-4cd6-a9e8-e9145579bb9f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:06.934195 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3751e90b-ab9d-4cd6-a9e8-e9145579bb9f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:06.976281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2872dfe7-94a0-443f-9c31-cf5ea5e6213b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:06.988763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2872dfe7-94a0-443f-9c31-cf5ea5e6213b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.088509 Jun 20 06:44:06.989346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1015/2094] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:06 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:07.078085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3751e90b-ab9d-4cd6-a9e8-e9145579bb9f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:07.085997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3751e90b-ab9d-4cd6-a9e8-e9145579bb9f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.164561 Jun 20 06:44:07.086561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1080/2095] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:06 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:44:08.005644 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3ce6de71-6b3f-4015-a051-be290137dcd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:08.006236 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3ce6de71-6b3f-4015-a051-be290137dcd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:08.013701 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ce6de71-6b3f-4015-a051-be290137dcd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:08.014154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ce6de71-6b3f-4015-a051-be290137dcd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:08.014904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ce6de71-6b3f-4015-a051-be290137dcd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:08.015339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ce6de71-6b3f-4015-a051-be290137dcd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:08.075561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3ce6de71-6b3f-4015-a051-be290137dcd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:08.082977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3ce6de71-6b3f-4015-a051-be290137dcd1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081253 Jun 20 06:44:08.083535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1016/2096] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:08 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:08.103554 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c7e80708-ddf5-465d-b47f-bd6ce6d73850 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:08.104591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c7e80708-ddf5-465d-b47f-bd6ce6d73850 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:08.111143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c7e80708-ddf5-465d-b47f-bd6ce6d73850 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:08.111589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c7e80708-ddf5-465d-b47f-bd6ce6d73850 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:08.112340 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c7e80708-ddf5-465d-b47f-bd6ce6d73850 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:08.112773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c7e80708-ddf5-465d-b47f-bd6ce6d73850 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:08.241247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c7e80708-ddf5-465d-b47f-bd6ce6d73850 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:08.249642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c7e80708-ddf5-465d-b47f-bd6ce6d73850 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.149808 Jun 20 06:44:08.250199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1081/2097] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:08 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:09.099209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f65414ab-01a8-44e7-b833-8b62b219fcf9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:09.099821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f65414ab-01a8-44e7-b833-8b62b219fcf9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:09.106779 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65414ab-01a8-44e7-b833-8b62b219fcf9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:09.107231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65414ab-01a8-44e7-b833-8b62b219fcf9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:09.107990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65414ab-01a8-44e7-b833-8b62b219fcf9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:09.108428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f65414ab-01a8-44e7-b833-8b62b219fcf9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:09.176678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f65414ab-01a8-44e7-b833-8b62b219fcf9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:09.184924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f65414ab-01a8-44e7-b833-8b62b219fcf9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.089569 Jun 20 06:44:09.185520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1017/2098] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:09 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:09.266809 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b8110fc1-5e2f-4e79-ae11-cf2ab5dcf93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:09.267336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b8110fc1-5e2f-4e79-ae11-cf2ab5dcf93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:09.273812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8110fc1-5e2f-4e79-ae11-cf2ab5dcf93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:09.274267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8110fc1-5e2f-4e79-ae11-cf2ab5dcf93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:09.275025 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8110fc1-5e2f-4e79-ae11-cf2ab5dcf93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:09.275466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8110fc1-5e2f-4e79-ae11-cf2ab5dcf93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:09.403323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b8110fc1-5e2f-4e79-ae11-cf2ab5dcf93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:09.411184 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b8110fc1-5e2f-4e79-ae11-cf2ab5dcf93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.148539 Jun 20 06:44:09.411746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1082/2099] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:09 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:10.201875 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-48b0459d-87d4-4daf-ac20-d6971f76de99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:10.202471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-48b0459d-87d4-4daf-ac20-d6971f76de99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:10.208844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48b0459d-87d4-4daf-ac20-d6971f76de99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:10.209291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48b0459d-87d4-4daf-ac20-d6971f76de99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:10.210073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48b0459d-87d4-4daf-ac20-d6971f76de99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:10.210506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48b0459d-87d4-4daf-ac20-d6971f76de99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:10.270996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-48b0459d-87d4-4daf-ac20-d6971f76de99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:10.279019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-48b0459d-87d4-4daf-ac20-d6971f76de99 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080930 Jun 20 06:44:10.279636 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1018/2100] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:10 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:10.428250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bc475235-a38a-4b21-b807-1c262ff17a51 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:10.428856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bc475235-a38a-4b21-b807-1c262ff17a51 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:10.435783 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc475235-a38a-4b21-b807-1c262ff17a51 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:10.436223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc475235-a38a-4b21-b807-1c262ff17a51 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:10.436970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc475235-a38a-4b21-b807-1c262ff17a51 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:10.437419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bc475235-a38a-4b21-b807-1c262ff17a51 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:10.451441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:10.568850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bc475235-a38a-4b21-b807-1c262ff17a51 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:10.578050 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bc475235-a38a-4b21-b807-1c262ff17a51 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.153566 Jun 20 06:44:10.578614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1083/2101] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:10 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:11.295912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-728b3d74-dc5f-41b1-9a14-fa1a8690856e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:11.296445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-728b3d74-dc5f-41b1-9a14-fa1a8690856e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:11.302950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-728b3d74-dc5f-41b1-9a14-fa1a8690856e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:11.303388 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-728b3d74-dc5f-41b1-9a14-fa1a8690856e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:11.304144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-728b3d74-dc5f-41b1-9a14-fa1a8690856e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:11.304576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-728b3d74-dc5f-41b1-9a14-fa1a8690856e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:11.366508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-728b3d74-dc5f-41b1-9a14-fa1a8690856e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:11.374887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-728b3d74-dc5f-41b1-9a14-fa1a8690856e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083436 Jun 20 06:44:11.375484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1019/2102] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:11 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:11.595019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8cea377e-9bd3-452a-9c34-d79e7fd067a9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:11.595622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8cea377e-9bd3-452a-9c34-d79e7fd067a9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:11.609825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cea377e-9bd3-452a-9c34-d79e7fd067a9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:11.610331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cea377e-9bd3-452a-9c34-d79e7fd067a9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:11.611286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cea377e-9bd3-452a-9c34-d79e7fd067a9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:11.611741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cea377e-9bd3-452a-9c34-d79e7fd067a9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:11.749926 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8cea377e-9bd3-452a-9c34-d79e7fd067a9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:11.757847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8cea377e-9bd3-452a-9c34-d79e7fd067a9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.166546 Jun 20 06:44:11.758411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1084/2103] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:11 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:12.391857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b0bf7dd-4a43-4fe3-b39e-933935d65c9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:12.392594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2b0bf7dd-4a43-4fe3-b39e-933935d65c9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:12.399149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b0bf7dd-4a43-4fe3-b39e-933935d65c9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:12.399605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b0bf7dd-4a43-4fe3-b39e-933935d65c9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:12.400374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b0bf7dd-4a43-4fe3-b39e-933935d65c9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:12.401521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b0bf7dd-4a43-4fe3-b39e-933935d65c9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:12.466929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b0bf7dd-4a43-4fe3-b39e-933935d65c9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:12.474520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2b0bf7dd-4a43-4fe3-b39e-933935d65c9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086779 Jun 20 06:44:12.475097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1020/2104] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:12 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:12.775470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cfec4700-eae5-4927-9861-7baefeb6a34e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:12.776398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cfec4700-eae5-4927-9861-7baefeb6a34e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:12.782977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfec4700-eae5-4927-9861-7baefeb6a34e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:12.783493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfec4700-eae5-4927-9861-7baefeb6a34e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:12.784251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfec4700-eae5-4927-9861-7baefeb6a34e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:12.784769 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cfec4700-eae5-4927-9861-7baefeb6a34e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:13.027968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cfec4700-eae5-4927-9861-7baefeb6a34e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:13.036123 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cfec4700-eae5-4927-9861-7baefeb6a34e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1558 microversion: 2.1 time: 0.264506 Jun 20 06:44:13.036696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1085/2105] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:12 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1558 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:13.296205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-38d75d34-352a-4a1a-96ca-fbb0395573e0 req-b77a3704-17c8-4c3e-be9c-30cf880f2e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb55995-a9da-4681-b95f-11657fea5562", "name": "network-vif-deleted", "tag": "7776b16e-74cc-45ad-9fbe-dcbcd64c7b21"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:44:13.305082 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-38d75d34-352a-4a1a-96ca-fbb0395573e0 req-b77a3704-17c8-4c3e-be9c-30cf880f2e03 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:13.305556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-38d75d34-352a-4a1a-96ca-fbb0395573e0 req-b77a3704-17c8-4c3e-be9c-30cf880f2e03 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:13.316881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-38d75d34-352a-4a1a-96ca-fbb0395573e0 req-b77a3704-17c8-4c3e-be9c-30cf880f2e03 service nova] Creating event network-vif-deleted:7776b16e-74cc-45ad-9fbe-dcbcd64c7b21 for instance 4cb55995-a9da-4681-b95f-11657fea5562 on hv-cinder-80473 Jun 20 06:44:13.322856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-38d75d34-352a-4a1a-96ca-fbb0395573e0 req-b77a3704-17c8-4c3e-be9c-30cf880f2e03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030024 Jun 20 06:44:13.323476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1021/2106] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:44:13.491825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57a33173-b5bf-4f8a-bf83-8faadb990ff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:13.492389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-57a33173-b5bf-4f8a-bf83-8faadb990ff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:13.498824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57a33173-b5bf-4f8a-bf83-8faadb990ff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:13.499275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57a33173-b5bf-4f8a-bf83-8faadb990ff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:13.500028 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57a33173-b5bf-4f8a-bf83-8faadb990ff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:13.500465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57a33173-b5bf-4f8a-bf83-8faadb990ff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:13.562108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-57a33173-b5bf-4f8a-bf83-8faadb990ff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:13.569422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-57a33173-b5bf-4f8a-bf83-8faadb990ff1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081518 Jun 20 06:44:13.569979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1086/2107] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:13 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:14.055344 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9f204233-a2ab-4b60-b84f-53e501c1fdb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:14.056069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9f204233-a2ab-4b60-b84f-53e501c1fdb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:14.062802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f204233-a2ab-4b60-b84f-53e501c1fdb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:14.063250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f204233-a2ab-4b60-b84f-53e501c1fdb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:14.064010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f204233-a2ab-4b60-b84f-53e501c1fdb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:14.064442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f204233-a2ab-4b60-b84f-53e501c1fdb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:14.125923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9f204233-a2ab-4b60-b84f-53e501c1fdb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:14.133732 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9f204233-a2ab-4b60-b84f-53e501c1fdb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083031 Jun 20 06:44:14.134302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1022/2108] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:14 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:14.586635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5355f09e-d912-4ae6-98a3-f08dc1ed24fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:14.587159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5355f09e-d912-4ae6-98a3-f08dc1ed24fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:14.593611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5355f09e-d912-4ae6-98a3-f08dc1ed24fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:14.594052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5355f09e-d912-4ae6-98a3-f08dc1ed24fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:14.594798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5355f09e-d912-4ae6-98a3-f08dc1ed24fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:14.595229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5355f09e-d912-4ae6-98a3-f08dc1ed24fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:14.656142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5355f09e-d912-4ae6-98a3-f08dc1ed24fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:14.663513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5355f09e-d912-4ae6-98a3-f08dc1ed24fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080883 Jun 20 06:44:14.664066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1087/2109] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:14 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:15.151757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1c58466c-59b8-4fd5-ae25-914c3f1d8325 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:15.152365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1c58466c-59b8-4fd5-ae25-914c3f1d8325 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:15.154377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:15.159752 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c58466c-59b8-4fd5-ae25-914c3f1d8325 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:15.160203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c58466c-59b8-4fd5-ae25-914c3f1d8325 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:15.160958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c58466c-59b8-4fd5-ae25-914c3f1d8325 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:15.161409 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1c58466c-59b8-4fd5-ae25-914c3f1d8325 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:15.225727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1c58466c-59b8-4fd5-ae25-914c3f1d8325 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:15.234155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1c58466c-59b8-4fd5-ae25-914c3f1d8325 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.086574 Jun 20 06:44:15.234744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1023/2110] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:15 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:15.682342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a1b8a07b-1030-491c-8913-8916059ceb3a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:15.683042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a1b8a07b-1030-491c-8913-8916059ceb3a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:15.689354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1b8a07b-1030-491c-8913-8916059ceb3a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:15.689825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1b8a07b-1030-491c-8913-8916059ceb3a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:15.690576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1b8a07b-1030-491c-8913-8916059ceb3a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:15.691002 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1b8a07b-1030-491c-8913-8916059ceb3a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:15.753349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a1b8a07b-1030-491c-8913-8916059ceb3a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:15.761460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a1b8a07b-1030-491c-8913-8916059ceb3a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083343 Jun 20 06:44:15.762224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1088/2111] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:15 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:44:16.250851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c4e5cfc7-1555-406a-b1ee-396b17313f01 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:16.251498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c4e5cfc7-1555-406a-b1ee-396b17313f01 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:16.258001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4e5cfc7-1555-406a-b1ee-396b17313f01 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:16.258458 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4e5cfc7-1555-406a-b1ee-396b17313f01 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:16.259226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4e5cfc7-1555-406a-b1ee-396b17313f01 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:16.259668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4e5cfc7-1555-406a-b1ee-396b17313f01 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:16.320262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c4e5cfc7-1555-406a-b1ee-396b17313f01 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:16.328319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c4e5cfc7-1555-406a-b1ee-396b17313f01 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081312 Jun 20 06:44:16.328892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1024/2112] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:16 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:16.779679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e9b5ad3c-6e40-4a0b-b69c-54f14f428096 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:16.780282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e9b5ad3c-6e40-4a0b-b69c-54f14f428096 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:16.782607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=54 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:16.787976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9b5ad3c-6e40-4a0b-b69c-54f14f428096 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:16.788425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9b5ad3c-6e40-4a0b-b69c-54f14f428096 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:16.789177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9b5ad3c-6e40-4a0b-b69c-54f14f428096 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:16.789646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9b5ad3c-6e40-4a0b-b69c-54f14f428096 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:16.850745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e9b5ad3c-6e40-4a0b-b69c-54f14f428096 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:16.858609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e9b5ad3c-6e40-4a0b-b69c-54f14f428096 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083893 Jun 20 06:44:16.859162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1089/2113] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:16 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:17.344766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e422c7b9-4958-4ca5-acd3-633faf38efe7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:17.345408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e422c7b9-4958-4ca5-acd3-633faf38efe7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:17.351961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e422c7b9-4958-4ca5-acd3-633faf38efe7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:17.352411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e422c7b9-4958-4ca5-acd3-633faf38efe7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:17.353193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e422c7b9-4958-4ca5-acd3-633faf38efe7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:17.354216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e422c7b9-4958-4ca5-acd3-633faf38efe7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:17.424069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e422c7b9-4958-4ca5-acd3-633faf38efe7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:17.433448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e422c7b9-4958-4ca5-acd3-633faf38efe7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.092358 Jun 20 06:44:17.434044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1025/2114] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:17 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:17.875856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-555dcef7-2757-4eb6-9ffe-9949465e8ba0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:17.876467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-555dcef7-2757-4eb6-9ffe-9949465e8ba0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:17.882995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-555dcef7-2757-4eb6-9ffe-9949465e8ba0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:17.883437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-555dcef7-2757-4eb6-9ffe-9949465e8ba0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:17.884185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-555dcef7-2757-4eb6-9ffe-9949465e8ba0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:17.884616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-555dcef7-2757-4eb6-9ffe-9949465e8ba0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:17.944562 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-555dcef7-2757-4eb6-9ffe-9949465e8ba0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:17.952055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-555dcef7-2757-4eb6-9ffe-9949465e8ba0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080172 Jun 20 06:44:17.952611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1090/2115] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:17 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:18.450460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f3cf4ca2-32ed-4254-9a4d-b8c6f0c83bcf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:18.451065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3cf4ca2-32ed-4254-9a4d-b8c6f0c83bcf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:18.457560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3cf4ca2-32ed-4254-9a4d-b8c6f0c83bcf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:18.458005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3cf4ca2-32ed-4254-9a4d-b8c6f0c83bcf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:18.458758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3cf4ca2-32ed-4254-9a4d-b8c6f0c83bcf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:18.459186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3cf4ca2-32ed-4254-9a4d-b8c6f0c83bcf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:18.522365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f3cf4ca2-32ed-4254-9a4d-b8c6f0c83bcf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:18.530718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f3cf4ca2-32ed-4254-9a4d-b8c6f0c83bcf tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084142 Jun 20 06:44:18.531307 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1026/2116] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:18 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:18.968774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9ecf67d9-544d-4f86-93f8-35913809d6a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:18.969424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9ecf67d9-544d-4f86-93f8-35913809d6a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:18.975873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ecf67d9-544d-4f86-93f8-35913809d6a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:18.976343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ecf67d9-544d-4f86-93f8-35913809d6a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:18.977103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ecf67d9-544d-4f86-93f8-35913809d6a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:18.977564 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ecf67d9-544d-4f86-93f8-35913809d6a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:19.038019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9ecf67d9-544d-4f86-93f8-35913809d6a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:19.046001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9ecf67d9-544d-4f86-93f8-35913809d6a2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081115 Jun 20 06:44:19.046567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1091/2117] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:18 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:19.548372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-67e42de1-0eeb-40fd-a744-14d858d1dbed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:19.548982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-67e42de1-0eeb-40fd-a744-14d858d1dbed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:19.555450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67e42de1-0eeb-40fd-a744-14d858d1dbed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:19.555901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67e42de1-0eeb-40fd-a744-14d858d1dbed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:19.557263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67e42de1-0eeb-40fd-a744-14d858d1dbed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:19.558266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67e42de1-0eeb-40fd-a744-14d858d1dbed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:19.560791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:19.623477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-67e42de1-0eeb-40fd-a744-14d858d1dbed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:19.631391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-67e42de1-0eeb-40fd-a744-14d858d1dbed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.086893 Jun 20 06:44:19.631948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1027/2118] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:19 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:20.063147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-01df9fa0-403c-495d-adec-fa71a0ad94bc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:20.063741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-01df9fa0-403c-495d-adec-fa71a0ad94bc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:20.070223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01df9fa0-403c-495d-adec-fa71a0ad94bc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:20.070669 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01df9fa0-403c-495d-adec-fa71a0ad94bc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:20.071421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01df9fa0-403c-495d-adec-fa71a0ad94bc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:20.071851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01df9fa0-403c-495d-adec-fa71a0ad94bc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:20.132664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-01df9fa0-403c-495d-adec-fa71a0ad94bc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:20.140917 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-01df9fa0-403c-495d-adec-fa71a0ad94bc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081701 Jun 20 06:44:20.141514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1092/2119] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:20 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:20.648340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-265a929c-bac0-4d40-8729-3003c64e8f34 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:20.648946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-265a929c-bac0-4d40-8729-3003c64e8f34 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:20.656159 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-265a929c-bac0-4d40-8729-3003c64e8f34 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:20.656600 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-265a929c-bac0-4d40-8729-3003c64e8f34 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:20.657352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-265a929c-bac0-4d40-8729-3003c64e8f34 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:20.657805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-265a929c-bac0-4d40-8729-3003c64e8f34 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:20.718431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-265a929c-bac0-4d40-8729-3003c64e8f34 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:20.726209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-265a929c-bac0-4d40-8729-3003c64e8f34 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081719 Jun 20 06:44:20.726768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1028/2120] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:20 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:21.157579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d56e0901-f73f-491c-864a-1e151cc6225f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:21.158213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d56e0901-f73f-491c-864a-1e151cc6225f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:21.164579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d56e0901-f73f-491c-864a-1e151cc6225f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:21.165022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d56e0901-f73f-491c-864a-1e151cc6225f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:21.165792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d56e0901-f73f-491c-864a-1e151cc6225f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:21.166727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d56e0901-f73f-491c-864a-1e151cc6225f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:21.225632 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d56e0901-f73f-491c-864a-1e151cc6225f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:21.234000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d56e0901-f73f-491c-864a-1e151cc6225f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080285 Jun 20 06:44:21.234567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1093/2121] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:21 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:21.743006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3dee3ef2-5e44-411e-adf8-fed0313a1125 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:21.743611 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3dee3ef2-5e44-411e-adf8-fed0313a1125 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:21.750379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3dee3ef2-5e44-411e-adf8-fed0313a1125 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:21.750824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3dee3ef2-5e44-411e-adf8-fed0313a1125 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:21.751578 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3dee3ef2-5e44-411e-adf8-fed0313a1125 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:21.752009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3dee3ef2-5e44-411e-adf8-fed0313a1125 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:21.814917 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3dee3ef2-5e44-411e-adf8-fed0313a1125 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:21.823271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3dee3ef2-5e44-411e-adf8-fed0313a1125 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084069 Jun 20 06:44:21.823827 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1029/2122] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:21 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:22.251257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-408e5ca3-37c9-4098-81ff-0045f1651201 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:22.251850 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-408e5ca3-37c9-4098-81ff-0045f1651201 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:22.258252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-408e5ca3-37c9-4098-81ff-0045f1651201 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:22.258707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-408e5ca3-37c9-4098-81ff-0045f1651201 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:22.259459 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-408e5ca3-37c9-4098-81ff-0045f1651201 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:22.260495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-408e5ca3-37c9-4098-81ff-0045f1651201 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:22.324258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-408e5ca3-37c9-4098-81ff-0045f1651201 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:22.331811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-408e5ca3-37c9-4098-81ff-0045f1651201 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084357 Jun 20 06:44:22.332366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1094/2123] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:22 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:22.840067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-54458a6e-5323-4c5f-bef3-4d63fe4a29d7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:22.840674 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54458a6e-5323-4c5f-bef3-4d63fe4a29d7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:22.847142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54458a6e-5323-4c5f-bef3-4d63fe4a29d7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:22.847587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54458a6e-5323-4c5f-bef3-4d63fe4a29d7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:22.848337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54458a6e-5323-4c5f-bef3-4d63fe4a29d7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:22.848767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54458a6e-5323-4c5f-bef3-4d63fe4a29d7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:22.910012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-54458a6e-5323-4c5f-bef3-4d63fe4a29d7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:22.918412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-54458a6e-5323-4c5f-bef3-4d63fe4a29d7 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082222 Jun 20 06:44:22.918976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1030/2124] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:22 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:23.348027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c26ded8f-e562-4019-b778-761ee5305fc2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:23.348642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c26ded8f-e562-4019-b778-761ee5305fc2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:23.356166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c26ded8f-e562-4019-b778-761ee5305fc2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:23.356618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c26ded8f-e562-4019-b778-761ee5305fc2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:23.357391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c26ded8f-e562-4019-b778-761ee5305fc2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:23.357844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c26ded8f-e562-4019-b778-761ee5305fc2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:23.569005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c26ded8f-e562-4019-b778-761ee5305fc2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:23.576956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c26ded8f-e562-4019-b778-761ee5305fc2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.232789 Jun 20 06:44:23.577543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1095/2125] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:23 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:23.935808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2645af2b-7136-48ab-bda6-01d00d53b2ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:23.936411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2645af2b-7136-48ab-bda6-01d00d53b2ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:23.942899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2645af2b-7136-48ab-bda6-01d00d53b2ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:23.943348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2645af2b-7136-48ab-bda6-01d00d53b2ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:23.944109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2645af2b-7136-48ab-bda6-01d00d53b2ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:23.944551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2645af2b-7136-48ab-bda6-01d00d53b2ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:24.010959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2645af2b-7136-48ab-bda6-01d00d53b2ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:24.019108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2645af2b-7136-48ab-bda6-01d00d53b2ea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.087834 Jun 20 06:44:24.019677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1031/2126] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:23 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:24.594374 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-562a0c71-927c-4ef0-929f-3ac541ee8e28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:24.594931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-562a0c71-927c-4ef0-929f-3ac541ee8e28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:24.601517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-562a0c71-927c-4ef0-929f-3ac541ee8e28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:24.601965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-562a0c71-927c-4ef0-929f-3ac541ee8e28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:24.602719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-562a0c71-927c-4ef0-929f-3ac541ee8e28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:24.603153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-562a0c71-927c-4ef0-929f-3ac541ee8e28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:24.663054 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-562a0c71-927c-4ef0-929f-3ac541ee8e28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:24.671160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-562a0c71-927c-4ef0-929f-3ac541ee8e28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080678 Jun 20 06:44:24.671711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1096/2127] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:24 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:25.034913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3405a70f-d278-401d-b49e-6cdcc9c90ddc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:25.035534 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3405a70f-d278-401d-b49e-6cdcc9c90ddc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:25.042459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3405a70f-d278-401d-b49e-6cdcc9c90ddc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:25.042915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3405a70f-d278-401d-b49e-6cdcc9c90ddc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:25.043682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3405a70f-d278-401d-b49e-6cdcc9c90ddc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:25.044124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3405a70f-d278-401d-b49e-6cdcc9c90ddc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:25.104302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3405a70f-d278-401d-b49e-6cdcc9c90ddc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:25.112307 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3405a70f-d278-401d-b49e-6cdcc9c90ddc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081301 Jun 20 06:44:25.112868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1032/2128] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:25 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:25.689015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3a7ae28b-62b0-444e-94c5-5dad96af66c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:25.689652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3a7ae28b-62b0-444e-94c5-5dad96af66c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:25.696365 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a7ae28b-62b0-444e-94c5-5dad96af66c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:25.696814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a7ae28b-62b0-444e-94c5-5dad96af66c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:25.697861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a7ae28b-62b0-444e-94c5-5dad96af66c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:25.698316 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a7ae28b-62b0-444e-94c5-5dad96af66c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:25.759073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3a7ae28b-62b0-444e-94c5-5dad96af66c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:25.772262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3a7ae28b-62b0-444e-94c5-5dad96af66c7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.087446 Jun 20 06:44:25.772829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1097/2129] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:25 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:26.129372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4f3697b9-7966-4ef4-aa5b-a0a3c666d421 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:26.130010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4f3697b9-7966-4ef4-aa5b-a0a3c666d421 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:26.136845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f3697b9-7966-4ef4-aa5b-a0a3c666d421 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:26.137290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f3697b9-7966-4ef4-aa5b-a0a3c666d421 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:26.138329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f3697b9-7966-4ef4-aa5b-a0a3c666d421 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:26.138792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f3697b9-7966-4ef4-aa5b-a0a3c666d421 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:26.202273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4f3697b9-7966-4ef4-aa5b-a0a3c666d421 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:26.210165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4f3697b9-7966-4ef4-aa5b-a0a3c666d421 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084682 Jun 20 06:44:26.210718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1033/2130] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:26 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:26.789637 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-63dcf5c3-f219-481a-b49d-17de80f95c70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:26.790248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-63dcf5c3-f219-481a-b49d-17de80f95c70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:26.796821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63dcf5c3-f219-481a-b49d-17de80f95c70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:26.797263 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63dcf5c3-f219-481a-b49d-17de80f95c70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:26.798042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63dcf5c3-f219-481a-b49d-17de80f95c70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:26.798475 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63dcf5c3-f219-481a-b49d-17de80f95c70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:26.858747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-63dcf5c3-f219-481a-b49d-17de80f95c70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:26.866267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-63dcf5c3-f219-481a-b49d-17de80f95c70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080581 Jun 20 06:44:26.866825 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1098/2131] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:26 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:27.227617 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a08fd373-6c61-499f-9d59-2526397ea39d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:27.228767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a08fd373-6c61-499f-9d59-2526397ea39d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:27.235681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a08fd373-6c61-499f-9d59-2526397ea39d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:27.236149 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a08fd373-6c61-499f-9d59-2526397ea39d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:27.236889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a08fd373-6c61-499f-9d59-2526397ea39d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:27.237323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a08fd373-6c61-499f-9d59-2526397ea39d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:27.298743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a08fd373-6c61-499f-9d59-2526397ea39d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:27.308246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a08fd373-6c61-499f-9d59-2526397ea39d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082752 Jun 20 06:44:27.309257 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1034/2132] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:27 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:27.883257 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7cdfbe1c-3ab3-406c-8e98-053eabe9279f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:27.883874 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7cdfbe1c-3ab3-406c-8e98-053eabe9279f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:27.891507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cdfbe1c-3ab3-406c-8e98-053eabe9279f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:27.891956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cdfbe1c-3ab3-406c-8e98-053eabe9279f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:27.892749 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cdfbe1c-3ab3-406c-8e98-053eabe9279f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:27.893186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cdfbe1c-3ab3-406c-8e98-053eabe9279f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:27.952866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7cdfbe1c-3ab3-406c-8e98-053eabe9279f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:27.960284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7cdfbe1c-3ab3-406c-8e98-053eabe9279f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080922 Jun 20 06:44:27.960831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1099/2133] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:27 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:28.325573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3e368791-a540-459b-a954-7f74e3f5874b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:28.326172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3e368791-a540-459b-a954-7f74e3f5874b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:28.332607 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e368791-a540-459b-a954-7f74e3f5874b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:28.333049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e368791-a540-459b-a954-7f74e3f5874b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:28.333833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e368791-a540-459b-a954-7f74e3f5874b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:28.334262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e368791-a540-459b-a954-7f74e3f5874b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:28.397820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3e368791-a540-459b-a954-7f74e3f5874b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:28.406171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3e368791-a540-459b-a954-7f74e3f5874b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084971 Jun 20 06:44:28.406755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1035/2134] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:28 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:28.977269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-37ec5ad0-42bb-4170-b7c1-fd985c6d0b26 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:28.977909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-37ec5ad0-42bb-4170-b7c1-fd985c6d0b26 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:28.984928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37ec5ad0-42bb-4170-b7c1-fd985c6d0b26 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:28.985372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37ec5ad0-42bb-4170-b7c1-fd985c6d0b26 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:28.986155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37ec5ad0-42bb-4170-b7c1-fd985c6d0b26 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:28.986645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37ec5ad0-42bb-4170-b7c1-fd985c6d0b26 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:28.990497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:29.046881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-37ec5ad0-42bb-4170-b7c1-fd985c6d0b26 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:29.054428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-37ec5ad0-42bb-4170-b7c1-fd985c6d0b26 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080936 Jun 20 06:44:29.054989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1100/2135] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:28 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:29.423111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8b0621c7-bfdc-4389-9158-8a4b4064a102 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:29.423718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8b0621c7-bfdc-4389-9158-8a4b4064a102 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:29.430352 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8b0621c7-bfdc-4389-9158-8a4b4064a102 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:29.430821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8b0621c7-bfdc-4389-9158-8a4b4064a102 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:29.431612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8b0621c7-bfdc-4389-9158-8a4b4064a102 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:29.432141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8b0621c7-bfdc-4389-9158-8a4b4064a102 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:29.491580 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8b0621c7-bfdc-4389-9158-8a4b4064a102 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:29.499368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8b0621c7-bfdc-4389-9158-8a4b4064a102 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080077 Jun 20 06:44:29.499931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1036/2136] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:29 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:30.070531 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-35b0186e-bb16-4040-b8cf-4efc079a8b9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:30.071121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-35b0186e-bb16-4040-b8cf-4efc079a8b9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:30.077812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35b0186e-bb16-4040-b8cf-4efc079a8b9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:30.078258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35b0186e-bb16-4040-b8cf-4efc079a8b9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:30.079014 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35b0186e-bb16-4040-b8cf-4efc079a8b9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:30.079443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35b0186e-bb16-4040-b8cf-4efc079a8b9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:30.098557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:44:30.098778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:44:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:44:30.142348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-35b0186e-bb16-4040-b8cf-4efc079a8b9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:30.149703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-35b0186e-bb16-4040-b8cf-4efc079a8b9c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082985 Jun 20 06:44:30.150308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1101/2137] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:30 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:30.515973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4b06f439-e62d-4f13-bdaa-40b7ea28aae4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:30.516609 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4b06f439-e62d-4f13-bdaa-40b7ea28aae4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:30.523099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b06f439-e62d-4f13-bdaa-40b7ea28aae4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:30.523541 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b06f439-e62d-4f13-bdaa-40b7ea28aae4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:30.524290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b06f439-e62d-4f13-bdaa-40b7ea28aae4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:30.524719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4b06f439-e62d-4f13-bdaa-40b7ea28aae4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:30.590393 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4b06f439-e62d-4f13-bdaa-40b7ea28aae4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:30.598243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4b06f439-e62d-4f13-bdaa-40b7ea28aae4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.086324 Jun 20 06:44:30.598797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1037/2138] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:30 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:31.166528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6412799d-325c-4698-9608-df8092e9fcd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:31.167137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6412799d-325c-4698-9608-df8092e9fcd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:31.173600 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6412799d-325c-4698-9608-df8092e9fcd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:31.174045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6412799d-325c-4698-9608-df8092e9fcd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:31.174791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6412799d-325c-4698-9608-df8092e9fcd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:31.175223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6412799d-325c-4698-9608-df8092e9fcd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:31.235949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6412799d-325c-4698-9608-df8092e9fcd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:31.243420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6412799d-325c-4698-9608-df8092e9fcd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081030 Jun 20 06:44:31.244532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1102/2139] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:31 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:31.615619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-43a7d908-08eb-4893-ba89-42fd4df5cc35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:31.616162 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-43a7d908-08eb-4893-ba89-42fd4df5cc35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:31.623675 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43a7d908-08eb-4893-ba89-42fd4df5cc35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:31.624130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43a7d908-08eb-4893-ba89-42fd4df5cc35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:31.624946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43a7d908-08eb-4893-ba89-42fd4df5cc35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:31.625400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43a7d908-08eb-4893-ba89-42fd4df5cc35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:31.688367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43a7d908-08eb-4893-ba89-42fd4df5cc35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:31.696270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-43a7d908-08eb-4893-ba89-42fd4df5cc35 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084573 Jun 20 06:44:31.696892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1038/2140] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:31 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:32.261279 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-efd56fd5-3cbc-4580-b38f-819d4d0c61e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:32.261928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-efd56fd5-3cbc-4580-b38f-819d4d0c61e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:32.268505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-efd56fd5-3cbc-4580-b38f-819d4d0c61e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:32.268944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-efd56fd5-3cbc-4580-b38f-819d4d0c61e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:32.269725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-efd56fd5-3cbc-4580-b38f-819d4d0c61e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:32.270156 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-efd56fd5-3cbc-4580-b38f-819d4d0c61e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:32.331832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-efd56fd5-3cbc-4580-b38f-819d4d0c61e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:32.340221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-efd56fd5-3cbc-4580-b38f-819d4d0c61e4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082910 Jun 20 06:44:32.340785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1103/2141] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:32 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:32.713010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f313bd3-5380-46ef-80eb-99aeeaab6225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:32.713686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f313bd3-5380-46ef-80eb-99aeeaab6225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:32.720126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f313bd3-5380-46ef-80eb-99aeeaab6225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:32.720565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f313bd3-5380-46ef-80eb-99aeeaab6225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:32.721315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f313bd3-5380-46ef-80eb-99aeeaab6225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:32.721791 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f313bd3-5380-46ef-80eb-99aeeaab6225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:32.784280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f313bd3-5380-46ef-80eb-99aeeaab6225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:32.792302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f313bd3-5380-46ef-80eb-99aeeaab6225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083203 Jun 20 06:44:32.792853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1039/2142] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:32 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:44:33.357742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-36344cc2-f6d3-4584-a79e-a0c105d9c03e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:33.358347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-36344cc2-f6d3-4584-a79e-a0c105d9c03e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:33.364397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-36344cc2-f6d3-4584-a79e-a0c105d9c03e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:33.364837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-36344cc2-f6d3-4584-a79e-a0c105d9c03e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:33.365616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-36344cc2-f6d3-4584-a79e-a0c105d9c03e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:33.366047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-36344cc2-f6d3-4584-a79e-a0c105d9c03e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:33.432133 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-36344cc2-f6d3-4584-a79e-a0c105d9c03e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:33.439726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-36344cc2-f6d3-4584-a79e-a0c105d9c03e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086341 Jun 20 06:44:33.440291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1104/2143] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:33 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:33.815258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f4d908e9-2562-4e0b-a177-5c7082497a74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:33.815892 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f4d908e9-2562-4e0b-a177-5c7082497a74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:33.823815 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f4d908e9-2562-4e0b-a177-5c7082497a74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:33.824262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f4d908e9-2562-4e0b-a177-5c7082497a74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:33.825049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f4d908e9-2562-4e0b-a177-5c7082497a74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:33.825515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f4d908e9-2562-4e0b-a177-5c7082497a74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:33.898845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f4d908e9-2562-4e0b-a177-5c7082497a74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:33.907943 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f4d908e9-2562-4e0b-a177-5c7082497a74 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.101826 Jun 20 06:44:33.908510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1040/2144] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:33 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:34.458923 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0c06ffdc-e459-43cf-8290-68b557bd60d4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:34.459595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0c06ffdc-e459-43cf-8290-68b557bd60d4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:34.466090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c06ffdc-e459-43cf-8290-68b557bd60d4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:34.466541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c06ffdc-e459-43cf-8290-68b557bd60d4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:34.467302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c06ffdc-e459-43cf-8290-68b557bd60d4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:34.467743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c06ffdc-e459-43cf-8290-68b557bd60d4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:34.528452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0c06ffdc-e459-43cf-8290-68b557bd60d4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:34.535887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0c06ffdc-e459-43cf-8290-68b557bd60d4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080853 Jun 20 06:44:34.536444 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1105/2145] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:34 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:34.925838 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0236edd5-cdce-428e-908a-656e1d7b0821 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:34.926446 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0236edd5-cdce-428e-908a-656e1d7b0821 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:34.932946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0236edd5-cdce-428e-908a-656e1d7b0821 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:34.933404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0236edd5-cdce-428e-908a-656e1d7b0821 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:34.934166 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0236edd5-cdce-428e-908a-656e1d7b0821 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:34.934595 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0236edd5-cdce-428e-908a-656e1d7b0821 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:34.997624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0236edd5-cdce-428e-908a-656e1d7b0821 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:35.005546 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0236edd5-cdce-428e-908a-656e1d7b0821 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083486 Jun 20 06:44:35.006108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1041/2146] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:34 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:35.553029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-af921aec-689e-4cfd-95ee-8fdf9e331114 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:35.553668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-af921aec-689e-4cfd-95ee-8fdf9e331114 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:35.560233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af921aec-689e-4cfd-95ee-8fdf9e331114 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:35.560676 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af921aec-689e-4cfd-95ee-8fdf9e331114 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:35.561443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af921aec-689e-4cfd-95ee-8fdf9e331114 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:35.561877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af921aec-689e-4cfd-95ee-8fdf9e331114 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:35.621720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-af921aec-689e-4cfd-95ee-8fdf9e331114 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:35.630136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-af921aec-689e-4cfd-95ee-8fdf9e331114 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080861 Jun 20 06:44:35.630707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1106/2147] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:35 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:36.023620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7583ef57-5a43-4551-b89e-310000581399 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:36.024240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7583ef57-5a43-4551-b89e-310000581399 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:36.031193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7583ef57-5a43-4551-b89e-310000581399 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:36.031642 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7583ef57-5a43-4551-b89e-310000581399 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:36.032403 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7583ef57-5a43-4551-b89e-310000581399 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:36.032843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7583ef57-5a43-4551-b89e-310000581399 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:36.093833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7583ef57-5a43-4551-b89e-310000581399 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:36.101535 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7583ef57-5a43-4551-b89e-310000581399 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081740 Jun 20 06:44:36.102103 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1042/2148] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:36 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:36.647596 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d85de8fc-5eaa-4327-9c60-b020561c9fb0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:36.648205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d85de8fc-5eaa-4327-9c60-b020561c9fb0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:36.655072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d85de8fc-5eaa-4327-9c60-b020561c9fb0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:36.655514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d85de8fc-5eaa-4327-9c60-b020561c9fb0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:36.656265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d85de8fc-5eaa-4327-9c60-b020561c9fb0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:36.656696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d85de8fc-5eaa-4327-9c60-b020561c9fb0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:36.716364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d85de8fc-5eaa-4327-9c60-b020561c9fb0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:36.723844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d85de8fc-5eaa-4327-9c60-b020561c9fb0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080062 Jun 20 06:44:36.724404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1107/2149] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:36 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:37.120529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a591000-57e5-4622-b24e-850ab6de64c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:37.121169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a591000-57e5-4622-b24e-850ab6de64c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:37.127551 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a591000-57e5-4622-b24e-850ab6de64c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:37.127993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a591000-57e5-4622-b24e-850ab6de64c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:37.128743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a591000-57e5-4622-b24e-850ab6de64c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:37.129177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a591000-57e5-4622-b24e-850ab6de64c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:37.192797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a591000-57e5-4622-b24e-850ab6de64c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:37.195009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:37.202612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a591000-57e5-4622-b24e-850ab6de64c4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.085917 Jun 20 06:44:37.203167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1043/2150] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:37 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:37.560900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:44:37.561151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:44:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:44:37.741299 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-68e1561c-18ef-4563-ac4c-91584a0f59ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:37.741976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-68e1561c-18ef-4563-ac4c-91584a0f59ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:37.749063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68e1561c-18ef-4563-ac4c-91584a0f59ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:37.749549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68e1561c-18ef-4563-ac4c-91584a0f59ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:37.750296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68e1561c-18ef-4563-ac4c-91584a0f59ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:37.750724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68e1561c-18ef-4563-ac4c-91584a0f59ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:37.812234 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-68e1561c-18ef-4563-ac4c-91584a0f59ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:37.819678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-68e1561c-18ef-4563-ac4c-91584a0f59ba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082212 Jun 20 06:44:37.820228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1108/2151] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:37 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:38.219462 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-26d270d5-9386-44cc-887f-dbf1bb697c48 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:38.220106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-26d270d5-9386-44cc-887f-dbf1bb697c48 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:38.226621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26d270d5-9386-44cc-887f-dbf1bb697c48 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:38.227067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26d270d5-9386-44cc-887f-dbf1bb697c48 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:38.227910 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26d270d5-9386-44cc-887f-dbf1bb697c48 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:38.228872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26d270d5-9386-44cc-887f-dbf1bb697c48 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:38.292722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26d270d5-9386-44cc-887f-dbf1bb697c48 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:38.300523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-26d270d5-9386-44cc-887f-dbf1bb697c48 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084954 Jun 20 06:44:38.301084 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1044/2152] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:38 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:38.836058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b9a1ad34-41ac-439c-9ff5-e4bc32b4b2ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:38.836665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b9a1ad34-41ac-439c-9ff5-e4bc32b4b2ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:38.843215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b9a1ad34-41ac-439c-9ff5-e4bc32b4b2ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:38.843665 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b9a1ad34-41ac-439c-9ff5-e4bc32b4b2ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:38.844430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b9a1ad34-41ac-439c-9ff5-e4bc32b4b2ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:38.844865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b9a1ad34-41ac-439c-9ff5-e4bc32b4b2ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:38.907319 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b9a1ad34-41ac-439c-9ff5-e4bc32b4b2ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:38.914798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b9a1ad34-41ac-439c-9ff5-e4bc32b4b2ca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082620 Jun 20 06:44:38.915367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1109/2153] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:38 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:39.316402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-435e9c2d-1a56-416c-ae94-86e66e3fae9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:39.317009 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-435e9c2d-1a56-416c-ae94-86e66e3fae9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:39.324094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-435e9c2d-1a56-416c-ae94-86e66e3fae9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:39.324543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-435e9c2d-1a56-416c-ae94-86e66e3fae9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:39.325312 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-435e9c2d-1a56-416c-ae94-86e66e3fae9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:39.326003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-435e9c2d-1a56-416c-ae94-86e66e3fae9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:39.391556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-435e9c2d-1a56-416c-ae94-86e66e3fae9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:39.399400 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-435e9c2d-1a56-416c-ae94-86e66e3fae9d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.086823 Jun 20 06:44:39.401062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1045/2154] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:39 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:39.797296 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:44:39.797591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:44:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:44:39.931449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f363ec9b-25e2-44b8-819a-e1147c96855a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:39.932061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f363ec9b-25e2-44b8-819a-e1147c96855a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:39.938605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f363ec9b-25e2-44b8-819a-e1147c96855a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:39.939059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f363ec9b-25e2-44b8-819a-e1147c96855a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:39.939821 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f363ec9b-25e2-44b8-819a-e1147c96855a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:39.940262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f363ec9b-25e2-44b8-819a-e1147c96855a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:40.000169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f363ec9b-25e2-44b8-819a-e1147c96855a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:40.007654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f363ec9b-25e2-44b8-819a-e1147c96855a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080079 Jun 20 06:44:40.008206 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1110/2155] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:39 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:40.417170 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-47156014-0282-4ef0-a480-b8b0e5256316 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:40.417797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-47156014-0282-4ef0-a480-b8b0e5256316 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:40.424466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47156014-0282-4ef0-a480-b8b0e5256316 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:40.425028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47156014-0282-4ef0-a480-b8b0e5256316 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:40.425829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47156014-0282-4ef0-a480-b8b0e5256316 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:40.426264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47156014-0282-4ef0-a480-b8b0e5256316 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:40.486934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-47156014-0282-4ef0-a480-b8b0e5256316 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:40.495152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-47156014-0282-4ef0-a480-b8b0e5256316 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081851 Jun 20 06:44:40.495730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1046/2156] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:40 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:41.026082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1ef78b11-8d65-4401-b356-f0d363304fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:41.026697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1ef78b11-8d65-4401-b356-f0d363304fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:41.033147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ef78b11-8d65-4401-b356-f0d363304fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:41.033631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ef78b11-8d65-4401-b356-f0d363304fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:41.034391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ef78b11-8d65-4401-b356-f0d363304fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:41.034855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ef78b11-8d65-4401-b356-f0d363304fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:41.095399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1ef78b11-8d65-4401-b356-f0d363304fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:41.103549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1ef78b11-8d65-4401-b356-f0d363304fad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081347 Jun 20 06:44:41.104269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1111/2157] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:41 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:41.512750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-96908b6b-7c91-46fd-833e-9584c77d3dfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:41.513347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-96908b6b-7c91-46fd-833e-9584c77d3dfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:41.519755 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96908b6b-7c91-46fd-833e-9584c77d3dfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:41.520198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96908b6b-7c91-46fd-833e-9584c77d3dfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:41.520945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96908b6b-7c91-46fd-833e-9584c77d3dfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:41.521391 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-96908b6b-7c91-46fd-833e-9584c77d3dfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:41.583941 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-96908b6b-7c91-46fd-833e-9584c77d3dfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:41.592475 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-96908b6b-7c91-46fd-833e-9584c77d3dfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084328 Jun 20 06:44:41.593028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1047/2158] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:41 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:42.121250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9d2ad548-789e-4206-a0dc-c95c0d1e4358 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:42.121882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9d2ad548-789e-4206-a0dc-c95c0d1e4358 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:42.128239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9d2ad548-789e-4206-a0dc-c95c0d1e4358 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:42.128683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9d2ad548-789e-4206-a0dc-c95c0d1e4358 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:42.129453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9d2ad548-789e-4206-a0dc-c95c0d1e4358 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:42.129882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9d2ad548-789e-4206-a0dc-c95c0d1e4358 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:42.190612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9d2ad548-789e-4206-a0dc-c95c0d1e4358 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:42.199126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9d2ad548-789e-4206-a0dc-c95c0d1e4358 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081741 Jun 20 06:44:42.199629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1112/2159] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:42 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:42.609407 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e93d4f6-9de2-49bd-9126-16e4dd93508b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:42.610039 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5e93d4f6-9de2-49bd-9126-16e4dd93508b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:42.616491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e93d4f6-9de2-49bd-9126-16e4dd93508b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:42.616951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e93d4f6-9de2-49bd-9126-16e4dd93508b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:42.617764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e93d4f6-9de2-49bd-9126-16e4dd93508b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:42.618206 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e93d4f6-9de2-49bd-9126-16e4dd93508b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:42.678847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e93d4f6-9de2-49bd-9126-16e4dd93508b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:42.687325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e93d4f6-9de2-49bd-9126-16e4dd93508b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081779 Jun 20 06:44:42.687885 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1048/2160] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:42 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:43.216735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0736f2a7-2071-46f8-a3ac-75ebb6a45801 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:43.217348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0736f2a7-2071-46f8-a3ac-75ebb6a45801 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:43.223920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0736f2a7-2071-46f8-a3ac-75ebb6a45801 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:43.224290 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0736f2a7-2071-46f8-a3ac-75ebb6a45801 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:43.225058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0736f2a7-2071-46f8-a3ac-75ebb6a45801 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:43.225526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0736f2a7-2071-46f8-a3ac-75ebb6a45801 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:43.287658 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0736f2a7-2071-46f8-a3ac-75ebb6a45801 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:43.295841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0736f2a7-2071-46f8-a3ac-75ebb6a45801 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083938 Jun 20 06:44:43.296394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1113/2161] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:43 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:43.707175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd9da26b-32c5-4cdb-83fa-d806ee5553ed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:43.707799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd9da26b-32c5-4cdb-83fa-d806ee5553ed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:43.715288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd9da26b-32c5-4cdb-83fa-d806ee5553ed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:43.715744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd9da26b-32c5-4cdb-83fa-d806ee5553ed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:43.716512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd9da26b-32c5-4cdb-83fa-d806ee5553ed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:43.716955 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd9da26b-32c5-4cdb-83fa-d806ee5553ed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:43.780243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd9da26b-32c5-4cdb-83fa-d806ee5553ed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:43.788111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd9da26b-32c5-4cdb-83fa-d806ee5553ed tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.087176 Jun 20 06:44:43.788678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1049/2162] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:43 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:44.313449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-147f46f3-1e5d-4a4a-a43b-7c5a97e2b49b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:44.314070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-147f46f3-1e5d-4a4a-a43b-7c5a97e2b49b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:44.320476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-147f46f3-1e5d-4a4a-a43b-7c5a97e2b49b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:44.320925 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-147f46f3-1e5d-4a4a-a43b-7c5a97e2b49b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:44.321709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-147f46f3-1e5d-4a4a-a43b-7c5a97e2b49b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:44.322149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-147f46f3-1e5d-4a4a-a43b-7c5a97e2b49b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:44.382966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-147f46f3-1e5d-4a4a-a43b-7c5a97e2b49b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:44.391399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-147f46f3-1e5d-4a4a-a43b-7c5a97e2b49b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081906 Jun 20 06:44:44.391952 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1114/2163] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:44 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:44.804355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-05f71c81-67e4-4948-963e-23642791ed69 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:44.804963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-05f71c81-67e4-4948-963e-23642791ed69 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:44.811177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05f71c81-67e4-4948-963e-23642791ed69 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:44.811621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05f71c81-67e4-4948-963e-23642791ed69 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:44.812404 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05f71c81-67e4-4948-963e-23642791ed69 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:44.812832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05f71c81-67e4-4948-963e-23642791ed69 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:44.872483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-05f71c81-67e4-4948-963e-23642791ed69 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:44.880852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-05f71c81-67e4-4948-963e-23642791ed69 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.079770 Jun 20 06:44:44.880852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1050/2164] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:44 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:45.408086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2f103596-9c4b-4bc8-9b0e-11d8488599b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:45.408739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2f103596-9c4b-4bc8-9b0e-11d8488599b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:45.415230 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f103596-9c4b-4bc8-9b0e-11d8488599b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:45.415679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f103596-9c4b-4bc8-9b0e-11d8488599b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:45.416439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f103596-9c4b-4bc8-9b0e-11d8488599b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:45.416903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f103596-9c4b-4bc8-9b0e-11d8488599b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:45.479680 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2f103596-9c4b-4bc8-9b0e-11d8488599b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:45.487187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2f103596-9c4b-4bc8-9b0e-11d8488599b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082975 Jun 20 06:44:45.487739 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1115/2165] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:45 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:45.898614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d1c4221-fe16-484e-9dca-f4e78da01ae9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:45.899214 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d1c4221-fe16-484e-9dca-f4e78da01ae9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:45.901594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:45.906840 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d1c4221-fe16-484e-9dca-f4e78da01ae9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:45.907292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d1c4221-fe16-484e-9dca-f4e78da01ae9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:45.908052 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d1c4221-fe16-484e-9dca-f4e78da01ae9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:45.908491 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d1c4221-fe16-484e-9dca-f4e78da01ae9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:45.974762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d1c4221-fe16-484e-9dca-f4e78da01ae9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:45.983508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d1c4221-fe16-484e-9dca-f4e78da01ae9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.088709 Jun 20 06:44:45.984075 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1051/2166] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:45 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:46.503679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-838d8652-d02c-47cb-bdef-4aef17ad2564 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:46.504497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-838d8652-d02c-47cb-bdef-4aef17ad2564 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:46.511831 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-838d8652-d02c-47cb-bdef-4aef17ad2564 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:46.512538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-838d8652-d02c-47cb-bdef-4aef17ad2564 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:46.513304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-838d8652-d02c-47cb-bdef-4aef17ad2564 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:46.513761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-838d8652-d02c-47cb-bdef-4aef17ad2564 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:46.574321 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-838d8652-d02c-47cb-bdef-4aef17ad2564 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:46.576505 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:46.583005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-838d8652-d02c-47cb-bdef-4aef17ad2564 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083061 Jun 20 06:44:46.583502 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1116/2167] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:46 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:47.000604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c2d2a6aa-b3a1-4cd1-bc61-c30ec3d36168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:47.001412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c2d2a6aa-b3a1-4cd1-bc61-c30ec3d36168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:47.008258 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2d2a6aa-b3a1-4cd1-bc61-c30ec3d36168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:47.008710 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2d2a6aa-b3a1-4cd1-bc61-c30ec3d36168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:47.009525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2d2a6aa-b3a1-4cd1-bc61-c30ec3d36168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:47.009960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c2d2a6aa-b3a1-4cd1-bc61-c30ec3d36168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:47.224873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c2d2a6aa-b3a1-4cd1-bc61-c30ec3d36168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:47.233331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c2d2a6aa-b3a1-4cd1-bc61-c30ec3d36168 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.236639 Jun 20 06:44:47.233915 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1052/2168] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:46 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:47.600779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fad0b82c-4c6a-4800-baf6-d69378d0f715 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:47.601350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fad0b82c-4c6a-4800-baf6-d69378d0f715 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:47.603869 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=56 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:47.609858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad0b82c-4c6a-4800-baf6-d69378d0f715 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:47.610311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad0b82c-4c6a-4800-baf6-d69378d0f715 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:47.611076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad0b82c-4c6a-4800-baf6-d69378d0f715 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:47.611521 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad0b82c-4c6a-4800-baf6-d69378d0f715 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:47.672538 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fad0b82c-4c6a-4800-baf6-d69378d0f715 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:47.680017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fad0b82c-4c6a-4800-baf6-d69378d0f715 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083210 Jun 20 06:44:47.680578 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1117/2169] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:47 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:48.250477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2154ac28-bd4a-4df7-9053-2135bec2a920 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:48.251022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2154ac28-bd4a-4df7-9053-2135bec2a920 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:48.257402 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2154ac28-bd4a-4df7-9053-2135bec2a920 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:48.257879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2154ac28-bd4a-4df7-9053-2135bec2a920 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:48.258633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2154ac28-bd4a-4df7-9053-2135bec2a920 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:48.259073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2154ac28-bd4a-4df7-9053-2135bec2a920 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:48.321250 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2154ac28-bd4a-4df7-9053-2135bec2a920 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:48.329807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2154ac28-bd4a-4df7-9053-2135bec2a920 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083234 Jun 20 06:44:48.330340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1053/2170] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:48 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:48.696365 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c91a62a3-46c2-4d89-b49b-7b755a15cff9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:48.697110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c91a62a3-46c2-4d89-b49b-7b755a15cff9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:48.704943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c91a62a3-46c2-4d89-b49b-7b755a15cff9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:48.705415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c91a62a3-46c2-4d89-b49b-7b755a15cff9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:48.706166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c91a62a3-46c2-4d89-b49b-7b755a15cff9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:48.706601 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c91a62a3-46c2-4d89-b49b-7b755a15cff9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:48.767236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c91a62a3-46c2-4d89-b49b-7b755a15cff9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:48.774738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c91a62a3-46c2-4d89-b49b-7b755a15cff9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082458 Jun 20 06:44:48.775306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1118/2171] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:48 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:49.346982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f2da288-4d65-4f41-8ebc-8d4b5bf5249a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:49.347588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f2da288-4d65-4f41-8ebc-8d4b5bf5249a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:49.354018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f2da288-4d65-4f41-8ebc-8d4b5bf5249a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:49.355033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f2da288-4d65-4f41-8ebc-8d4b5bf5249a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:49.355823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f2da288-4d65-4f41-8ebc-8d4b5bf5249a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:49.356251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f2da288-4d65-4f41-8ebc-8d4b5bf5249a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:49.415762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f2da288-4d65-4f41-8ebc-8d4b5bf5249a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:49.424078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f2da288-4d65-4f41-8ebc-8d4b5bf5249a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080959 Jun 20 06:44:49.424627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1054/2172] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:49 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:49.791478 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f4dfde3b-00d0-4158-a7ee-1831bd80041c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:49.792106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f4dfde3b-00d0-4158-a7ee-1831bd80041c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:49.798800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4dfde3b-00d0-4158-a7ee-1831bd80041c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:49.799246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4dfde3b-00d0-4158-a7ee-1831bd80041c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:49.800096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4dfde3b-00d0-4158-a7ee-1831bd80041c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:49.800534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4dfde3b-00d0-4158-a7ee-1831bd80041c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:49.859974 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f4dfde3b-00d0-4158-a7ee-1831bd80041c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:49.867430 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f4dfde3b-00d0-4158-a7ee-1831bd80041c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.079785 Jun 20 06:44:49.867991 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1119/2173] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:49 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:50.440787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7d73a010-810e-4328-a6ef-94dcbc07e43c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:50.441417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7d73a010-810e-4328-a6ef-94dcbc07e43c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:50.447996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d73a010-810e-4328-a6ef-94dcbc07e43c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:50.448460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d73a010-810e-4328-a6ef-94dcbc07e43c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:50.449226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d73a010-810e-4328-a6ef-94dcbc07e43c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:50.449697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7d73a010-810e-4328-a6ef-94dcbc07e43c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:50.511832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7d73a010-810e-4328-a6ef-94dcbc07e43c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:50.520028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7d73a010-810e-4328-a6ef-94dcbc07e43c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083074 Jun 20 06:44:50.520585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1055/2174] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:50 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:50.884807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2c388fa3-ae69-4341-b855-a43a5c75ac5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:50.885833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2c388fa3-ae69-4341-b855-a43a5c75ac5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:50.892223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c388fa3-ae69-4341-b855-a43a5c75ac5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:50.892664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c388fa3-ae69-4341-b855-a43a5c75ac5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:50.893437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c388fa3-ae69-4341-b855-a43a5c75ac5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:50.893870 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c388fa3-ae69-4341-b855-a43a5c75ac5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:50.954255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2c388fa3-ae69-4341-b855-a43a5c75ac5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:50.961515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2c388fa3-ae69-4341-b855-a43a5c75ac5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080523 Jun 20 06:44:50.962070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1120/2175] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:50 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:51.537512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c8850582-1206-42e6-b28e-cc8f951f7cb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:51.538238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c8850582-1206-42e6-b28e-cc8f951f7cb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:51.545126 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8850582-1206-42e6-b28e-cc8f951f7cb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:51.545616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8850582-1206-42e6-b28e-cc8f951f7cb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:51.546363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8850582-1206-42e6-b28e-cc8f951f7cb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:51.546801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8850582-1206-42e6-b28e-cc8f951f7cb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:51.606975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c8850582-1206-42e6-b28e-cc8f951f7cb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:51.614695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c8850582-1206-42e6-b28e-cc8f951f7cb8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081124 Jun 20 06:44:51.615271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1056/2176] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:51 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:51.979514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1b155602-c3a4-4a32-8aaa-c446b5626f1e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:51.980366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1b155602-c3a4-4a32-8aaa-c446b5626f1e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:51.987262 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b155602-c3a4-4a32-8aaa-c446b5626f1e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:51.987710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b155602-c3a4-4a32-8aaa-c446b5626f1e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:51.988482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b155602-c3a4-4a32-8aaa-c446b5626f1e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:51.988915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b155602-c3a4-4a32-8aaa-c446b5626f1e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:52.053187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1b155602-c3a4-4a32-8aaa-c446b5626f1e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:52.061750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1b155602-c3a4-4a32-8aaa-c446b5626f1e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086531 Jun 20 06:44:52.062408 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1121/2177] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:51 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:52.631993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8b8f921-d054-4917-8b01-e7b706e985f4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:52.632605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8b8f921-d054-4917-8b01-e7b706e985f4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:52.639778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8b8f921-d054-4917-8b01-e7b706e985f4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:52.640226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8b8f921-d054-4917-8b01-e7b706e985f4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:52.640975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8b8f921-d054-4917-8b01-e7b706e985f4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:52.641438 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8b8f921-d054-4917-8b01-e7b706e985f4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:52.703516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8b8f921-d054-4917-8b01-e7b706e985f4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:52.711412 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8b8f921-d054-4917-8b01-e7b706e985f4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083244 Jun 20 06:44:52.711963 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1057/2178] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:52 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:53.079338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b37fed1d-dbb7-4d6d-93a3-4c8afb98f6ff tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:53.079947 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b37fed1d-dbb7-4d6d-93a3-4c8afb98f6ff tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:53.086335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b37fed1d-dbb7-4d6d-93a3-4c8afb98f6ff tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:53.086808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b37fed1d-dbb7-4d6d-93a3-4c8afb98f6ff tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:53.087554 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b37fed1d-dbb7-4d6d-93a3-4c8afb98f6ff tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:53.087988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b37fed1d-dbb7-4d6d-93a3-4c8afb98f6ff tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:53.148098 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b37fed1d-dbb7-4d6d-93a3-4c8afb98f6ff tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:53.155611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b37fed1d-dbb7-4d6d-93a3-4c8afb98f6ff tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080158 Jun 20 06:44:53.156160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1122/2179] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:53 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:53.728895 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-35df61d5-b09e-40e4-bff3-d504a17f3b9a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:53.730338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-35df61d5-b09e-40e4-bff3-d504a17f3b9a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:53.736567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35df61d5-b09e-40e4-bff3-d504a17f3b9a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:53.737012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35df61d5-b09e-40e4-bff3-d504a17f3b9a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:53.737793 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35df61d5-b09e-40e4-bff3-d504a17f3b9a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:53.738223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-35df61d5-b09e-40e4-bff3-d504a17f3b9a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:53.801072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-35df61d5-b09e-40e4-bff3-d504a17f3b9a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:53.809060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-35df61d5-b09e-40e4-bff3-d504a17f3b9a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083991 Jun 20 06:44:53.809647 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1058/2180] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:53 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:54.172260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a28fcfbd-c795-43a0-9bf6-25d907d9bcec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:54.172893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a28fcfbd-c795-43a0-9bf6-25d907d9bcec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:54.179501 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a28fcfbd-c795-43a0-9bf6-25d907d9bcec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:54.180107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a28fcfbd-c795-43a0-9bf6-25d907d9bcec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:54.180939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a28fcfbd-c795-43a0-9bf6-25d907d9bcec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:54.181372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a28fcfbd-c795-43a0-9bf6-25d907d9bcec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:54.242902 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a28fcfbd-c795-43a0-9bf6-25d907d9bcec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:54.250395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a28fcfbd-c795-43a0-9bf6-25d907d9bcec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081927 Jun 20 06:44:54.250948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1123/2181] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:54 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:54.826021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ad77806e-93a4-4275-a552-ec082449245f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:54.826663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ad77806e-93a4-4275-a552-ec082449245f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:54.833109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad77806e-93a4-4275-a552-ec082449245f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:54.833592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad77806e-93a4-4275-a552-ec082449245f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:54.834348 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad77806e-93a4-4275-a552-ec082449245f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:54.834786 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad77806e-93a4-4275-a552-ec082449245f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:54.898110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ad77806e-93a4-4275-a552-ec082449245f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:54.906063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ad77806e-93a4-4275-a552-ec082449245f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084154 Jun 20 06:44:54.906619 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1059/2182] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:54 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:55.267356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-567710ac-29f9-4318-a0da-49579dbcdc4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:55.267961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-567710ac-29f9-4318-a0da-49579dbcdc4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:55.274322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-567710ac-29f9-4318-a0da-49579dbcdc4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:55.274767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-567710ac-29f9-4318-a0da-49579dbcdc4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:55.275514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-567710ac-29f9-4318-a0da-49579dbcdc4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:55.276543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-567710ac-29f9-4318-a0da-49579dbcdc4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:55.335822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-567710ac-29f9-4318-a0da-49579dbcdc4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:55.344001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-567710ac-29f9-4318-a0da-49579dbcdc4f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080465 Jun 20 06:44:55.344559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1124/2183] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:55 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:55.923069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5ebfce04-3f51-4d03-bc7f-e29e8dd35c67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:55.923686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5ebfce04-3f51-4d03-bc7f-e29e8dd35c67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:55.930092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ebfce04-3f51-4d03-bc7f-e29e8dd35c67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:55.930564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ebfce04-3f51-4d03-bc7f-e29e8dd35c67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:55.931318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ebfce04-3f51-4d03-bc7f-e29e8dd35c67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:55.931753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ebfce04-3f51-4d03-bc7f-e29e8dd35c67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:55.946904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:44:55.998898 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5ebfce04-3f51-4d03-bc7f-e29e8dd35c67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:56.006777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5ebfce04-3f51-4d03-bc7f-e29e8dd35c67 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.087538 Jun 20 06:44:56.007330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1060/2184] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:55 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:56.360697 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-42046269-53cf-4b7e-bcfe-20cc7fe4599b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:56.361308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-42046269-53cf-4b7e-bcfe-20cc7fe4599b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:56.367808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42046269-53cf-4b7e-bcfe-20cc7fe4599b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:56.368254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42046269-53cf-4b7e-bcfe-20cc7fe4599b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:56.369013 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42046269-53cf-4b7e-bcfe-20cc7fe4599b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:56.370470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-42046269-53cf-4b7e-bcfe-20cc7fe4599b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:56.430282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-42046269-53cf-4b7e-bcfe-20cc7fe4599b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:56.438590 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-42046269-53cf-4b7e-bcfe-20cc7fe4599b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081760 Jun 20 06:44:56.439149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1125/2185] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:56 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:57.024330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6454ca7a-bc2b-4b32-9271-f71ff1511312 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:57.024933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6454ca7a-bc2b-4b32-9271-f71ff1511312 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:57.032275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6454ca7a-bc2b-4b32-9271-f71ff1511312 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:57.032719 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6454ca7a-bc2b-4b32-9271-f71ff1511312 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:57.033499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6454ca7a-bc2b-4b32-9271-f71ff1511312 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:57.033935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6454ca7a-bc2b-4b32-9271-f71ff1511312 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:57.096225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6454ca7a-bc2b-4b32-9271-f71ff1511312 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:57.104580 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6454ca7a-bc2b-4b32-9271-f71ff1511312 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083520 Jun 20 06:44:57.105137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1061/2186] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:57 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:57.455743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8b331976-15d2-45eb-adac-00b41abf22ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:57.456349 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8b331976-15d2-45eb-adac-00b41abf22ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:57.462735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b331976-15d2-45eb-adac-00b41abf22ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:57.463684 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b331976-15d2-45eb-adac-00b41abf22ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:57.464657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b331976-15d2-45eb-adac-00b41abf22ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:57.465088 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b331976-15d2-45eb-adac-00b41abf22ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:57.524331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8b331976-15d2-45eb-adac-00b41abf22ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:57.532176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8b331976-15d2-45eb-adac-00b41abf22ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080251 Jun 20 06:44:57.532726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1126/2187] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:57 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:58.121201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a9df5d00-597c-4110-a5d3-8e17f4bb57d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:58.121825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a9df5d00-597c-4110-a5d3-8e17f4bb57d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:58.128197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9df5d00-597c-4110-a5d3-8e17f4bb57d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:58.128638 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9df5d00-597c-4110-a5d3-8e17f4bb57d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:58.129397 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9df5d00-597c-4110-a5d3-8e17f4bb57d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:58.129837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a9df5d00-597c-4110-a5d3-8e17f4bb57d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:58.190326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a9df5d00-597c-4110-a5d3-8e17f4bb57d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:58.198679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a9df5d00-597c-4110-a5d3-8e17f4bb57d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081857 Jun 20 06:44:58.199234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1062/2188] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:58 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:58.548779 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e40dbd2d-4ec7-4767-9222-b69daf3dd993 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:58.549405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e40dbd2d-4ec7-4767-9222-b69daf3dd993 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:58.555832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e40dbd2d-4ec7-4767-9222-b69daf3dd993 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:58.556285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e40dbd2d-4ec7-4767-9222-b69daf3dd993 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:58.557128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e40dbd2d-4ec7-4767-9222-b69daf3dd993 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:58.557635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e40dbd2d-4ec7-4767-9222-b69daf3dd993 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:58.625032 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e40dbd2d-4ec7-4767-9222-b69daf3dd993 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:58.633327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e40dbd2d-4ec7-4767-9222-b69daf3dd993 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.088348 Jun 20 06:44:58.634265 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1127/2189] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:58 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:59.215613 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-29ef780f-7ebe-4be8-98f4-1aaa8142e931 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:59.216155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-29ef780f-7ebe-4be8-98f4-1aaa8142e931 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:59.222643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29ef780f-7ebe-4be8-98f4-1aaa8142e931 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:59.223084 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29ef780f-7ebe-4be8-98f4-1aaa8142e931 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:59.223834 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29ef780f-7ebe-4be8-98f4-1aaa8142e931 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:59.224262 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29ef780f-7ebe-4be8-98f4-1aaa8142e931 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:59.287729 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-29ef780f-7ebe-4be8-98f4-1aaa8142e931 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:59.296225 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-29ef780f-7ebe-4be8-98f4-1aaa8142e931 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084569 Jun 20 06:44:59.296783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1063/2190] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:59 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:44:59.650439 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5bfc9e6d-4c3b-4211-9c00-f5e7a3726b28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:44:59.651055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5bfc9e6d-4c3b-4211-9c00-f5e7a3726b28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:44:59.658200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bfc9e6d-4c3b-4211-9c00-f5e7a3726b28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:59.658646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bfc9e6d-4c3b-4211-9c00-f5e7a3726b28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:59.659432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bfc9e6d-4c3b-4211-9c00-f5e7a3726b28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:44:59.659865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5bfc9e6d-4c3b-4211-9c00-f5e7a3726b28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:44:59.720700 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5bfc9e6d-4c3b-4211-9c00-f5e7a3726b28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:44:59.728121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5bfc9e6d-4c3b-4211-9c00-f5e7a3726b28 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081545 Jun 20 06:44:59.728715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1128/2191] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:44:59 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:00.312927 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cbfa734f-4a26-48ed-bf6b-3b35c3d392ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:00.313685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cbfa734f-4a26-48ed-bf6b-3b35c3d392ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:00.320062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cbfa734f-4a26-48ed-bf6b-3b35c3d392ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:00.320516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cbfa734f-4a26-48ed-bf6b-3b35c3d392ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:00.321281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cbfa734f-4a26-48ed-bf6b-3b35c3d392ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:00.321762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cbfa734f-4a26-48ed-bf6b-3b35c3d392ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:00.384967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cbfa734f-4a26-48ed-bf6b-3b35c3d392ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:00.393900 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cbfa734f-4a26-48ed-bf6b-3b35c3d392ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084868 Jun 20 06:45:00.394471 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1064/2192] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:00 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:00.745960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-75530a00-9d43-45cc-940e-b7ff96c8537e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:00.746562 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-75530a00-9d43-45cc-940e-b7ff96c8537e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:00.752895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75530a00-9d43-45cc-940e-b7ff96c8537e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:00.753336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75530a00-9d43-45cc-940e-b7ff96c8537e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:00.754115 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75530a00-9d43-45cc-940e-b7ff96c8537e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:00.754546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75530a00-9d43-45cc-940e-b7ff96c8537e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:00.813618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-75530a00-9d43-45cc-940e-b7ff96c8537e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:00.821003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-75530a00-9d43-45cc-940e-b7ff96c8537e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.079504 Jun 20 06:45:00.821519 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1129/2193] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:00 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:01.410597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e31dafd9-8d39-41dd-a4b4-a2e57e743b36 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:01.411299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e31dafd9-8d39-41dd-a4b4-a2e57e743b36 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:01.416683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:01.417775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e31dafd9-8d39-41dd-a4b4-a2e57e743b36 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:01.418011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:01.418428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e31dafd9-8d39-41dd-a4b4-a2e57e743b36 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:01.419203 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e31dafd9-8d39-41dd-a4b4-a2e57e743b36 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:01.419650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e31dafd9-8d39-41dd-a4b4-a2e57e743b36 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:01.424335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:01.424791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:01.425585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:01.426063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:01.440929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] HTTP exception thrown: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Request method failure captured: Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 HTTP/1.1 Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBEqJDeZtlG-76F9Hi4_noX4_tneao6vpYIiYQyaYvdpuOkX8aoM1hpdwBXJme_lnOgm3F_vrfWtSCxavSew2AgbdU00NoRsq1ru6feT1r9ReY4KmDcnf7fvgIEVVBT7oFxAdaOflWS25iHWid_ZHHLne8-r_H3tLh3LxO6zrjUIz_g Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:45:01.442758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}] Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 5fc0e8fe250349d699ea43aeee98170e Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.444451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'bbf69dcc-0fce-409f-878a-a3ab64d3b0a0'} Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:45:01.445341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.446841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.448423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Returning 404 to user: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:45:01.448423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8981ee50-3caa-49a9-978b-4f779b2def24 tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 404 len: 111 microversion: 2.20 time: 0.031767 Jun 20 06:45:01.448423 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1130/2194] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Jun 20 06:45:01 2022] DELETE /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:45:01.452878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:01.453534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] [instance: bbf69dcc-0fce-409f-878a-a3ab64d3b0a0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:01.459432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:01.459873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:01.460636 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:01.461066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:01.476297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] HTTP exception thrown: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Request method failure captured: Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 HTTP/1.1 Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBEqJDeZtlG-76F9Hi4_noX4_tneao6vpYIiYQyaYvdpuOkX8aoM1hpdwBXJme_lnOgm3F_vrfWtSCxavSew2AgbdU00NoRsq1ru6feT1r9ReY4KmDcnf7fvgIEVVBT7oFxAdaOflWS25iHWid_ZHHLne8-r_H3tLh3LxO6zrjUIz_g Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:45:01.477862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a2203406ec34776ab1a1e663601baaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a2203406ec34776ab1a1e663601baaf"}]}] Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 8a2203406ec34776ab1a1e663601baaf Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1826573072 Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 5fc0e8fe250349d699ea43aeee98170e Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1826573072-project Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.480312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': 'bbf69dcc-0fce-409f-878a-a3ab64d3b0a0'} Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:45:01.481623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. Jun 20 06:45:01.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:45:01.484355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] Returning 404 to user: Instance bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:45:01.484355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8ef2d5b3-ceff-4a5d-a5c7-c027376ad76a tempest-AttachVolumeShelveTestJSON-1826573072 tempest-AttachVolumeShelveTestJSON-1826573072-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0" status: 404 len: 111 microversion: 2.20 time: 0.029817 Jun 20 06:45:01.484355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1131/2195] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jun 20 06:45:01 2022] GET /compute/v2.1/servers/bbf69dcc-0fce-409f-878a-a3ab64d3b0a0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:45:01.487237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e31dafd9-8d39-41dd-a4b4-a2e57e743b36 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:01.495881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e31dafd9-8d39-41dd-a4b4-a2e57e743b36 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.088486 Jun 20 06:45:01.496812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1065/2196] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:01 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:01.838468 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-26162e87-7ff0-40c6-8918-f056642973f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:01.839570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-26162e87-7ff0-40c6-8918-f056642973f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:01.845911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26162e87-7ff0-40c6-8918-f056642973f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:01.846376 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26162e87-7ff0-40c6-8918-f056642973f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:01.847124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26162e87-7ff0-40c6-8918-f056642973f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:01.847554 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26162e87-7ff0-40c6-8918-f056642973f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:01.932030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-26162e87-7ff0-40c6-8918-f056642973f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:01.939516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-26162e87-7ff0-40c6-8918-f056642973f1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.105036 Jun 20 06:45:01.940082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1132/2197] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:01 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:02.513069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-805d3267-1286-4c22-aa80-12959768c3b2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:02.513705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-805d3267-1286-4c22-aa80-12959768c3b2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:02.520247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-805d3267-1286-4c22-aa80-12959768c3b2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:02.520691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-805d3267-1286-4c22-aa80-12959768c3b2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:02.521474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-805d3267-1286-4c22-aa80-12959768c3b2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:02.521907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-805d3267-1286-4c22-aa80-12959768c3b2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:02.592049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-805d3267-1286-4c22-aa80-12959768c3b2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:02.600272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-805d3267-1286-4c22-aa80-12959768c3b2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.092008 Jun 20 06:45:02.600855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1066/2198] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:02 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:02.958571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-705fcdfb-ed60-41a2-98c1-6b824118574e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:02.959192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-705fcdfb-ed60-41a2-98c1-6b824118574e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:02.966805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-705fcdfb-ed60-41a2-98c1-6b824118574e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:02.967255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-705fcdfb-ed60-41a2-98c1-6b824118574e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:02.968035 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-705fcdfb-ed60-41a2-98c1-6b824118574e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:02.968471 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-705fcdfb-ed60-41a2-98c1-6b824118574e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:03.090072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-705fcdfb-ed60-41a2-98c1-6b824118574e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:03.097559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-705fcdfb-ed60-41a2-98c1-6b824118574e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.144420 Jun 20 06:45:03.098147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1133/2199] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:02 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:03.617192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-419f794f-bcc4-4650-a1d3-7d1d392b2d4e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:03.617950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-419f794f-bcc4-4650-a1d3-7d1d392b2d4e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:03.624839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-419f794f-bcc4-4650-a1d3-7d1d392b2d4e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:03.625594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-419f794f-bcc4-4650-a1d3-7d1d392b2d4e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:03.626376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-419f794f-bcc4-4650-a1d3-7d1d392b2d4e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:03.626818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-419f794f-bcc4-4650-a1d3-7d1d392b2d4e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:03.705704 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-419f794f-bcc4-4650-a1d3-7d1d392b2d4e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:03.715234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-419f794f-bcc4-4650-a1d3-7d1d392b2d4e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.100795 Jun 20 06:45:03.725026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1067/2200] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:03 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:04.116065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-90bc87ea-7e46-43d0-9121-dd286af13205 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:04.117258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-90bc87ea-7e46-43d0-9121-dd286af13205 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:04.124464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90bc87ea-7e46-43d0-9121-dd286af13205 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:04.124908 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90bc87ea-7e46-43d0-9121-dd286af13205 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:04.126473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90bc87ea-7e46-43d0-9121-dd286af13205 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:04.126910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90bc87ea-7e46-43d0-9121-dd286af13205 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:04.219994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-90bc87ea-7e46-43d0-9121-dd286af13205 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:04.222598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:04.229392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-90bc87ea-7e46-43d0-9121-dd286af13205 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.118247 Jun 20 06:45:04.230584 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1134/2201] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:04 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:04.748157 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a3083a6f-6568-428d-9401-a12048e5b768 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:04.749268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a3083a6f-6568-428d-9401-a12048e5b768 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:04.759867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3083a6f-6568-428d-9401-a12048e5b768 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:04.760415 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3083a6f-6568-428d-9401-a12048e5b768 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:04.762421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3083a6f-6568-428d-9401-a12048e5b768 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:04.762986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3083a6f-6568-428d-9401-a12048e5b768 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:04.848634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a3083a6f-6568-428d-9401-a12048e5b768 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:04.858635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a3083a6f-6568-428d-9401-a12048e5b768 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.129517 Jun 20 06:45:04.859294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1068/2202] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:04 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:05.247707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e178b94b-a078-4d2a-a4dd-a232bb864a1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:05.248401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e178b94b-a078-4d2a-a4dd-a232bb864a1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:05.254878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e178b94b-a078-4d2a-a4dd-a232bb864a1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:05.255390 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e178b94b-a078-4d2a-a4dd-a232bb864a1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:05.256241 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e178b94b-a078-4d2a-a4dd-a232bb864a1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:05.256735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e178b94b-a078-4d2a-a4dd-a232bb864a1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:05.325956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e178b94b-a078-4d2a-a4dd-a232bb864a1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:05.334076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e178b94b-a078-4d2a-a4dd-a232bb864a1a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.090386 Jun 20 06:45:05.334666 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1135/2203] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:05 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:05.876575 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b1a41383-26e3-46dd-a117-709d32d396f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:05.877186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b1a41383-26e3-46dd-a117-709d32d396f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:05.883538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1a41383-26e3-46dd-a117-709d32d396f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:05.883986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1a41383-26e3-46dd-a117-709d32d396f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:05.884748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1a41383-26e3-46dd-a117-709d32d396f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:05.885220 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1a41383-26e3-46dd-a117-709d32d396f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:05.949416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1a41383-26e3-46dd-a117-709d32d396f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:05.957459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b1a41383-26e3-46dd-a117-709d32d396f9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084860 Jun 20 06:45:05.958055 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1069/2204] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:05 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:06.351189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6de1db73-5f04-4122-9b94-d0ad5f71cdc5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:06.351805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6de1db73-5f04-4122-9b94-d0ad5f71cdc5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:06.358738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de1db73-5f04-4122-9b94-d0ad5f71cdc5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:06.359198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de1db73-5f04-4122-9b94-d0ad5f71cdc5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:06.359965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de1db73-5f04-4122-9b94-d0ad5f71cdc5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:06.360403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de1db73-5f04-4122-9b94-d0ad5f71cdc5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:06.424178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6de1db73-5f04-4122-9b94-d0ad5f71cdc5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:06.432018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6de1db73-5f04-4122-9b94-d0ad5f71cdc5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084671 Jun 20 06:45:06.432722 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1136/2205] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:06 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:45:06.974261 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8f41441-8704-4316-be1f-49e4242595e1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:06.974896 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8f41441-8704-4316-be1f-49e4242595e1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:06.981319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8f41441-8704-4316-be1f-49e4242595e1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:06.981785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8f41441-8704-4316-be1f-49e4242595e1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:06.982568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8f41441-8704-4316-be1f-49e4242595e1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:06.983394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8f41441-8704-4316-be1f-49e4242595e1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:07.043468 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8f41441-8704-4316-be1f-49e4242595e1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:07.051247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8f41441-8704-4316-be1f-49e4242595e1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080819 Jun 20 06:45:07.051801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1070/2206] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:06 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:07.449271 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c42b408c-ecda-453d-b673-649bef5ccfdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:07.449911 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c42b408c-ecda-453d-b673-649bef5ccfdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:07.456351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c42b408c-ecda-453d-b673-649bef5ccfdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:07.456802 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c42b408c-ecda-453d-b673-649bef5ccfdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:07.457605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c42b408c-ecda-453d-b673-649bef5ccfdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:07.458047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c42b408c-ecda-453d-b673-649bef5ccfdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:07.525558 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c42b408c-ecda-453d-b673-649bef5ccfdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:07.533556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c42b408c-ecda-453d-b673-649bef5ccfdd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.088782 Jun 20 06:45:07.534139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1137/2207] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:07 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:08.068181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ad6d62ee-2bcf-4d1b-bca5-ceca0b4f80d1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:08.068774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ad6d62ee-2bcf-4d1b-bca5-ceca0b4f80d1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:08.075641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad6d62ee-2bcf-4d1b-bca5-ceca0b4f80d1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:08.076095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad6d62ee-2bcf-4d1b-bca5-ceca0b4f80d1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:08.076857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad6d62ee-2bcf-4d1b-bca5-ceca0b4f80d1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:08.077293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ad6d62ee-2bcf-4d1b-bca5-ceca0b4f80d1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:08.141015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ad6d62ee-2bcf-4d1b-bca5-ceca0b4f80d1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:08.148744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ad6d62ee-2bcf-4d1b-bca5-ceca0b4f80d1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084438 Jun 20 06:45:08.149306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1071/2208] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:08 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:08.551335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-881ad318-fdf7-42c8-aeb3-4b22aaf2b5ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:08.551976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-881ad318-fdf7-42c8-aeb3-4b22aaf2b5ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:08.558894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881ad318-fdf7-42c8-aeb3-4b22aaf2b5ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:08.559347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881ad318-fdf7-42c8-aeb3-4b22aaf2b5ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:08.560103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881ad318-fdf7-42c8-aeb3-4b22aaf2b5ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:08.560537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881ad318-fdf7-42c8-aeb3-4b22aaf2b5ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:08.626030 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-881ad318-fdf7-42c8-aeb3-4b22aaf2b5ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:08.633426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-881ad318-fdf7-42c8-aeb3-4b22aaf2b5ee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085977 Jun 20 06:45:08.634003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1138/2209] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:08 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:09.166045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c09bbeee-0b46-4b80-862d-3d5b61e2ad2b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:09.166688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c09bbeee-0b46-4b80-862d-3d5b61e2ad2b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:09.173794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c09bbeee-0b46-4b80-862d-3d5b61e2ad2b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:09.174245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c09bbeee-0b46-4b80-862d-3d5b61e2ad2b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:09.175004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c09bbeee-0b46-4b80-862d-3d5b61e2ad2b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:09.175442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c09bbeee-0b46-4b80-862d-3d5b61e2ad2b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:09.236079 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c09bbeee-0b46-4b80-862d-3d5b61e2ad2b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:09.243990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c09bbeee-0b46-4b80-862d-3d5b61e2ad2b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081774 Jun 20 06:45:09.244547 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1072/2210] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:09 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:09.651038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fb09035e-9542-4b70-9979-fbb350592d55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:09.652227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fb09035e-9542-4b70-9979-fbb350592d55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:09.658573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb09035e-9542-4b70-9979-fbb350592d55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:09.659016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb09035e-9542-4b70-9979-fbb350592d55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:09.659760 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb09035e-9542-4b70-9979-fbb350592d55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:09.660189 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb09035e-9542-4b70-9979-fbb350592d55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:09.722832 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fb09035e-9542-4b70-9979-fbb350592d55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:09.730827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fb09035e-9542-4b70-9979-fbb350592d55 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083689 Jun 20 06:45:09.731390 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1139/2211] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:09 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:10.261886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-452eb95c-2b06-4ed7-a6e0-d7e01930885b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:10.262766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-452eb95c-2b06-4ed7-a6e0-d7e01930885b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:10.269217 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-452eb95c-2b06-4ed7-a6e0-d7e01930885b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:10.269772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-452eb95c-2b06-4ed7-a6e0-d7e01930885b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:10.270540 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-452eb95c-2b06-4ed7-a6e0-d7e01930885b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:10.270982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-452eb95c-2b06-4ed7-a6e0-d7e01930885b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:10.332088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-452eb95c-2b06-4ed7-a6e0-d7e01930885b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:10.340035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-452eb95c-2b06-4ed7-a6e0-d7e01930885b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082745 Jun 20 06:45:10.340584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1073/2212] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:10 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:10.747849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ddd0fe0e-075b-4320-b1fa-550632f0295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:10.748474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ddd0fe0e-075b-4320-b1fa-550632f0295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:10.754930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ddd0fe0e-075b-4320-b1fa-550632f0295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:10.755374 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ddd0fe0e-075b-4320-b1fa-550632f0295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:10.756128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ddd0fe0e-075b-4320-b1fa-550632f0295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:10.756559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ddd0fe0e-075b-4320-b1fa-550632f0295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:10.816293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ddd0fe0e-075b-4320-b1fa-550632f0295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:10.823781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ddd0fe0e-075b-4320-b1fa-550632f0295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080728 Jun 20 06:45:10.824333 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1140/2213] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:10 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:11.356464 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0e5b92d5-9bab-427c-b0a1-2d1c7e9d3ef0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:11.357102 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0e5b92d5-9bab-427c-b0a1-2d1c7e9d3ef0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:11.363584 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e5b92d5-9bab-427c-b0a1-2d1c7e9d3ef0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:11.364038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e5b92d5-9bab-427c-b0a1-2d1c7e9d3ef0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:11.364802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e5b92d5-9bab-427c-b0a1-2d1c7e9d3ef0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:11.365247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e5b92d5-9bab-427c-b0a1-2d1c7e9d3ef0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:11.426778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0e5b92d5-9bab-427c-b0a1-2d1c7e9d3ef0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:11.435201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0e5b92d5-9bab-427c-b0a1-2d1c7e9d3ef0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083113 Jun 20 06:45:11.435747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1074/2214] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:11 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:11.840971 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-85e585e1-5d1a-423a-81aa-3e2490fad92e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:11.841614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-85e585e1-5d1a-423a-81aa-3e2490fad92e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:11.848159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85e585e1-5d1a-423a-81aa-3e2490fad92e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:11.848603 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85e585e1-5d1a-423a-81aa-3e2490fad92e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:11.849354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85e585e1-5d1a-423a-81aa-3e2490fad92e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:11.849812 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85e585e1-5d1a-423a-81aa-3e2490fad92e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:11.912977 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-85e585e1-5d1a-423a-81aa-3e2490fad92e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:11.921597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-85e585e1-5d1a-423a-81aa-3e2490fad92e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085045 Jun 20 06:45:11.922155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1141/2215] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:11 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:12.451746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-01c9b044-12f8-437c-b6e6-40df23a10cfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:12.452355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-01c9b044-12f8-437c-b6e6-40df23a10cfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:12.459003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01c9b044-12f8-437c-b6e6-40df23a10cfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:12.459485 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01c9b044-12f8-437c-b6e6-40df23a10cfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:12.460301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01c9b044-12f8-437c-b6e6-40df23a10cfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:12.460739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01c9b044-12f8-437c-b6e6-40df23a10cfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:12.521954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-01c9b044-12f8-437c-b6e6-40df23a10cfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:12.529836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-01c9b044-12f8-437c-b6e6-40df23a10cfc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082620 Jun 20 06:45:12.530392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1075/2216] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:12 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:12.938846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a25f291b-3ad5-4ca9-a3f6-90f1f80a6eed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:12.939479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a25f291b-3ad5-4ca9-a3f6-90f1f80a6eed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:12.945862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a25f291b-3ad5-4ca9-a3f6-90f1f80a6eed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:12.946304 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a25f291b-3ad5-4ca9-a3f6-90f1f80a6eed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:12.947048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a25f291b-3ad5-4ca9-a3f6-90f1f80a6eed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:12.947476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a25f291b-3ad5-4ca9-a3f6-90f1f80a6eed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:13.008654 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a25f291b-3ad5-4ca9-a3f6-90f1f80a6eed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:13.016862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a25f291b-3ad5-4ca9-a3f6-90f1f80a6eed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081845 Jun 20 06:45:13.017437 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1142/2217] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:12 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:13.547125 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c25ad2ac-598f-4b82-8137-75a13983158b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:13.547677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c25ad2ac-598f-4b82-8137-75a13983158b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:13.554186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c25ad2ac-598f-4b82-8137-75a13983158b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:13.554657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c25ad2ac-598f-4b82-8137-75a13983158b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:13.555486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c25ad2ac-598f-4b82-8137-75a13983158b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:13.555919 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c25ad2ac-598f-4b82-8137-75a13983158b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:13.615975 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c25ad2ac-598f-4b82-8137-75a13983158b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:13.624479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c25ad2ac-598f-4b82-8137-75a13983158b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081275 Jun 20 06:45:13.625035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1076/2218] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:13 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:14.033616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ca63b3f8-8f42-480d-a42f-39c7d9d8a597 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:14.034228 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ca63b3f8-8f42-480d-a42f-39c7d9d8a597 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:14.040656 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca63b3f8-8f42-480d-a42f-39c7d9d8a597 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:14.041103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca63b3f8-8f42-480d-a42f-39c7d9d8a597 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:14.042599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca63b3f8-8f42-480d-a42f-39c7d9d8a597 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:14.043048 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca63b3f8-8f42-480d-a42f-39c7d9d8a597 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:14.106247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ca63b3f8-8f42-480d-a42f-39c7d9d8a597 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:14.113628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ca63b3f8-8f42-480d-a42f-39c7d9d8a597 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083812 Jun 20 06:45:14.114185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1143/2219] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:14 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:14.644210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c919d0fc-d71f-41f7-880d-b752789102ad tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:14.644819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c919d0fc-d71f-41f7-880d-b752789102ad tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:14.650808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c919d0fc-d71f-41f7-880d-b752789102ad tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:14.651452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c919d0fc-d71f-41f7-880d-b752789102ad tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:14.652753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c919d0fc-d71f-41f7-880d-b752789102ad tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:14.653586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c919d0fc-d71f-41f7-880d-b752789102ad tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:14.657117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:14.719260 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c919d0fc-d71f-41f7-880d-b752789102ad tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:14.727028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c919d0fc-d71f-41f7-880d-b752789102ad tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.086962 Jun 20 06:45:14.727585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1077/2220] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:14 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:15.130330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c1b87f1c-a00e-4678-a611-dc134a7f9f5a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:15.130941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c1b87f1c-a00e-4678-a611-dc134a7f9f5a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:15.137785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1b87f1c-a00e-4678-a611-dc134a7f9f5a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:15.138233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1b87f1c-a00e-4678-a611-dc134a7f9f5a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:15.138985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1b87f1c-a00e-4678-a611-dc134a7f9f5a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:15.139420 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c1b87f1c-a00e-4678-a611-dc134a7f9f5a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:15.200394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c1b87f1c-a00e-4678-a611-dc134a7f9f5a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:15.207744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c1b87f1c-a00e-4678-a611-dc134a7f9f5a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081252 Jun 20 06:45:15.208298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1144/2221] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:15 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:15.743673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9549f26c-e783-4c6c-a11f-052e0a314e4c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:15.744293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9549f26c-e783-4c6c-a11f-052e0a314e4c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:15.750988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9549f26c-e783-4c6c-a11f-052e0a314e4c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:15.751447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9549f26c-e783-4c6c-a11f-052e0a314e4c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:15.752216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9549f26c-e783-4c6c-a11f-052e0a314e4c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:15.752658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9549f26c-e783-4c6c-a11f-052e0a314e4c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:15.814533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9549f26c-e783-4c6c-a11f-052e0a314e4c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:15.822405 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9549f26c-e783-4c6c-a11f-052e0a314e4c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082594 Jun 20 06:45:15.823552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1078/2222] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:15 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:16.223973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f8ed7d96-59b8-4cac-81dc-0d7999f03280 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:16.224622 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f8ed7d96-59b8-4cac-81dc-0d7999f03280 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:16.231052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8ed7d96-59b8-4cac-81dc-0d7999f03280 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:16.231494 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8ed7d96-59b8-4cac-81dc-0d7999f03280 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:16.232247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8ed7d96-59b8-4cac-81dc-0d7999f03280 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:16.232685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8ed7d96-59b8-4cac-81dc-0d7999f03280 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:16.296056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f8ed7d96-59b8-4cac-81dc-0d7999f03280 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:16.303451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f8ed7d96-59b8-4cac-81dc-0d7999f03280 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083340 Jun 20 06:45:16.304008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1145/2223] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:16 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:16.840376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8d60588-ce5a-4bc8-8a76-6c3c33673576 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:16.840986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8d60588-ce5a-4bc8-8a76-6c3c33673576 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:16.843323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:16.848740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8d60588-ce5a-4bc8-8a76-6c3c33673576 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:16.849193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8d60588-ce5a-4bc8-8a76-6c3c33673576 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:16.849990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8d60588-ce5a-4bc8-8a76-6c3c33673576 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:16.850428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8d60588-ce5a-4bc8-8a76-6c3c33673576 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:16.910758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8d60588-ce5a-4bc8-8a76-6c3c33673576 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:16.919044 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8d60588-ce5a-4bc8-8a76-6c3c33673576 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083136 Jun 20 06:45:16.919601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1079/2224] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:16 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:17.321365 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-725993e9-e202-41cf-a044-a4f805f4773b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:17.322130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-725993e9-e202-41cf-a044-a4f805f4773b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:17.329285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725993e9-e202-41cf-a044-a4f805f4773b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:17.329777 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725993e9-e202-41cf-a044-a4f805f4773b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:17.330554 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725993e9-e202-41cf-a044-a4f805f4773b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:17.330993 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725993e9-e202-41cf-a044-a4f805f4773b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:17.395670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-725993e9-e202-41cf-a044-a4f805f4773b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:17.403737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-725993e9-e202-41cf-a044-a4f805f4773b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086236 Jun 20 06:45:17.404300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1146/2225] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:17 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:17.936536 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-31043c90-b359-4809-93ab-56b348e3637a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:17.937148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-31043c90-b359-4809-93ab-56b348e3637a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:17.943870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31043c90-b359-4809-93ab-56b348e3637a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:17.944318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31043c90-b359-4809-93ab-56b348e3637a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:17.945066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31043c90-b359-4809-93ab-56b348e3637a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:17.945527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31043c90-b359-4809-93ab-56b348e3637a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:18.007283 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-31043c90-b359-4809-93ab-56b348e3637a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:18.015902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-31043c90-b359-4809-93ab-56b348e3637a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084008 Jun 20 06:45:18.016455 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1080/2226] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:17 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:18.420395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-52b23201-b82d-4285-ab7b-bad78bf89385 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:18.421009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-52b23201-b82d-4285-ab7b-bad78bf89385 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:18.423318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=60 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:18.428518 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b23201-b82d-4285-ab7b-bad78bf89385 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:18.428965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b23201-b82d-4285-ab7b-bad78bf89385 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:18.429766 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b23201-b82d-4285-ab7b-bad78bf89385 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:18.430207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-52b23201-b82d-4285-ab7b-bad78bf89385 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:18.492964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-52b23201-b82d-4285-ab7b-bad78bf89385 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:18.500599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-52b23201-b82d-4285-ab7b-bad78bf89385 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084658 Jun 20 06:45:18.501162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1147/2227] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:18 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:19.033113 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d130cf79-b97a-413c-a785-e84e5578c2a0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:19.033771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d130cf79-b97a-413c-a785-e84e5578c2a0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:19.040280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d130cf79-b97a-413c-a785-e84e5578c2a0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:19.040731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d130cf79-b97a-413c-a785-e84e5578c2a0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:19.041583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d130cf79-b97a-413c-a785-e84e5578c2a0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:19.042106 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d130cf79-b97a-413c-a785-e84e5578c2a0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:19.101804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d130cf79-b97a-413c-a785-e84e5578c2a0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:19.109854 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d130cf79-b97a-413c-a785-e84e5578c2a0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080629 Jun 20 06:45:19.110416 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1081/2228] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:19 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:19.517781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0f5905cd-039c-4bb5-9236-e07dd928aca1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:19.518396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0f5905cd-039c-4bb5-9236-e07dd928aca1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:19.524827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f5905cd-039c-4bb5-9236-e07dd928aca1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:19.525273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f5905cd-039c-4bb5-9236-e07dd928aca1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:19.526065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f5905cd-039c-4bb5-9236-e07dd928aca1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:19.526511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0f5905cd-039c-4bb5-9236-e07dd928aca1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:19.587233 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0f5905cd-039c-4bb5-9236-e07dd928aca1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:19.594694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0f5905cd-039c-4bb5-9236-e07dd928aca1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080870 Jun 20 06:45:19.595252 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1148/2229] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:19 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:20.126937 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6d3d68f7-0f68-48b2-b928-20e2b88aa829 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:20.127542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6d3d68f7-0f68-48b2-b928-20e2b88aa829 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:20.133978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d3d68f7-0f68-48b2-b928-20e2b88aa829 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:20.134425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d3d68f7-0f68-48b2-b928-20e2b88aa829 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:20.135180 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d3d68f7-0f68-48b2-b928-20e2b88aa829 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:20.135616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d3d68f7-0f68-48b2-b928-20e2b88aa829 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:20.195447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6d3d68f7-0f68-48b2-b928-20e2b88aa829 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:20.204143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6d3d68f7-0f68-48b2-b928-20e2b88aa829 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081086 Jun 20 06:45:20.204695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1082/2230] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:20 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:20.611449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0735eacf-36d6-47b1-9fae-b58636c9abdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:20.612120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0735eacf-36d6-47b1-9fae-b58636c9abdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:20.618543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0735eacf-36d6-47b1-9fae-b58636c9abdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:20.618995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0735eacf-36d6-47b1-9fae-b58636c9abdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:20.619756 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0735eacf-36d6-47b1-9fae-b58636c9abdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:20.620194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0735eacf-36d6-47b1-9fae-b58636c9abdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:20.685282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0735eacf-36d6-47b1-9fae-b58636c9abdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:20.692797 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0735eacf-36d6-47b1-9fae-b58636c9abdf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085239 Jun 20 06:45:20.693354 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1149/2231] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:20 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:21.220054 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1be44a18-5384-4cd4-9eb8-0ae1071490c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:21.220662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1be44a18-5384-4cd4-9eb8-0ae1071490c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:21.227111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1be44a18-5384-4cd4-9eb8-0ae1071490c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:21.227558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1be44a18-5384-4cd4-9eb8-0ae1071490c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:21.228314 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1be44a18-5384-4cd4-9eb8-0ae1071490c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:21.228749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1be44a18-5384-4cd4-9eb8-0ae1071490c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:21.288851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1be44a18-5384-4cd4-9eb8-0ae1071490c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:21.297418 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1be44a18-5384-4cd4-9eb8-0ae1071490c8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081177 Jun 20 06:45:21.297973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1083/2232] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:21 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:45:21.709920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5e20100e-731d-4bd8-8197-e5d082093eca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:21.710528 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5e20100e-731d-4bd8-8197-e5d082093eca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:21.717579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5e20100e-731d-4bd8-8197-e5d082093eca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:21.718023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5e20100e-731d-4bd8-8197-e5d082093eca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:21.718771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5e20100e-731d-4bd8-8197-e5d082093eca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:21.719201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5e20100e-731d-4bd8-8197-e5d082093eca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:21.779425 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5e20100e-731d-4bd8-8197-e5d082093eca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:21.786897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5e20100e-731d-4bd8-8197-e5d082093eca tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080795 Jun 20 06:45:21.787449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1150/2233] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:21 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:22.315434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aa8f2a03-980f-4138-9e82-16049789cf94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:22.316057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aa8f2a03-980f-4138-9e82-16049789cf94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:22.322564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a03-980f-4138-9e82-16049789cf94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:22.323019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a03-980f-4138-9e82-16049789cf94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:22.323787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a03-980f-4138-9e82-16049789cf94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:22.324227 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa8f2a03-980f-4138-9e82-16049789cf94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:22.388574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-aa8f2a03-980f-4138-9e82-16049789cf94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:22.396494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aa8f2a03-980f-4138-9e82-16049789cf94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084919 Jun 20 06:45:22.397051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1084/2234] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:22 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:22.803756 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5c0e1ea4-3dde-42e8-86f3-bfe14cda1533 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:22.804364 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5c0e1ea4-3dde-42e8-86f3-bfe14cda1533 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:22.811860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c0e1ea4-3dde-42e8-86f3-bfe14cda1533 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:22.812345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c0e1ea4-3dde-42e8-86f3-bfe14cda1533 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:22.813136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c0e1ea4-3dde-42e8-86f3-bfe14cda1533 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:22.813678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c0e1ea4-3dde-42e8-86f3-bfe14cda1533 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:22.827895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:22.876746 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5c0e1ea4-3dde-42e8-86f3-bfe14cda1533 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:22.884255 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5c0e1ea4-3dde-42e8-86f3-bfe14cda1533 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084336 Jun 20 06:45:22.884818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1151/2235] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:22 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:23.413559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89d81ba3-0f1d-450a-9087-03ea1ac43225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:23.414173 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-89d81ba3-0f1d-450a-9087-03ea1ac43225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:23.420613 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89d81ba3-0f1d-450a-9087-03ea1ac43225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:23.421071 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89d81ba3-0f1d-450a-9087-03ea1ac43225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:23.421861 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89d81ba3-0f1d-450a-9087-03ea1ac43225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:23.422321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89d81ba3-0f1d-450a-9087-03ea1ac43225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:23.483006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-89d81ba3-0f1d-450a-9087-03ea1ac43225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:23.490922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89d81ba3-0f1d-450a-9087-03ea1ac43225 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081233 Jun 20 06:45:23.491479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1085/2236] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:23 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:23.901283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-159cfb39-1294-42d8-aa83-b4ace07c874c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:23.901943 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-159cfb39-1294-42d8-aa83-b4ace07c874c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:23.908712 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-159cfb39-1294-42d8-aa83-b4ace07c874c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:23.909155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-159cfb39-1294-42d8-aa83-b4ace07c874c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:23.909973 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-159cfb39-1294-42d8-aa83-b4ace07c874c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:23.910403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-159cfb39-1294-42d8-aa83-b4ace07c874c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:23.970635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-159cfb39-1294-42d8-aa83-b4ace07c874c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:23.977999 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-159cfb39-1294-42d8-aa83-b4ace07c874c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080548 Jun 20 06:45:23.978550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1152/2237] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:23 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:24.507743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-df16462e-84ab-4afc-a1ef-9ba52f382ba0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:24.508345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-df16462e-84ab-4afc-a1ef-9ba52f382ba0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:24.515117 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df16462e-84ab-4afc-a1ef-9ba52f382ba0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:24.515562 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df16462e-84ab-4afc-a1ef-9ba52f382ba0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:24.516310 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df16462e-84ab-4afc-a1ef-9ba52f382ba0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:24.516743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df16462e-84ab-4afc-a1ef-9ba52f382ba0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:24.576643 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-df16462e-84ab-4afc-a1ef-9ba52f382ba0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:24.584515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-df16462e-84ab-4afc-a1ef-9ba52f382ba0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080542 Jun 20 06:45:24.585011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1086/2238] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:24 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:24.995384 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-abb71e3a-5a8f-44b1-aa8b-34e990151733 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:24.996005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-abb71e3a-5a8f-44b1-aa8b-34e990151733 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:25.002906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-abb71e3a-5a8f-44b1-aa8b-34e990151733 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:25.003360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-abb71e3a-5a8f-44b1-aa8b-34e990151733 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:25.004122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-abb71e3a-5a8f-44b1-aa8b-34e990151733 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:25.004568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-abb71e3a-5a8f-44b1-aa8b-34e990151733 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:25.069909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-abb71e3a-5a8f-44b1-aa8b-34e990151733 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:25.077921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-abb71e3a-5a8f-44b1-aa8b-34e990151733 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086413 Jun 20 06:45:25.078482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1153/2239] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:24 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:25.602411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-011b78eb-fbd9-49ad-976a-7e9b4fb35973 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:25.602789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-011b78eb-fbd9-49ad-976a-7e9b4fb35973 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:25.609961 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-011b78eb-fbd9-49ad-976a-7e9b4fb35973 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:25.610406 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-011b78eb-fbd9-49ad-976a-7e9b4fb35973 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:25.611156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-011b78eb-fbd9-49ad-976a-7e9b4fb35973 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:25.611588 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-011b78eb-fbd9-49ad-976a-7e9b4fb35973 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:25.671821 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-011b78eb-fbd9-49ad-976a-7e9b4fb35973 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:25.679615 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-011b78eb-fbd9-49ad-976a-7e9b4fb35973 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081276 Jun 20 06:45:25.680186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1087/2240] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:25 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:26.095897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dfc32d4f-b042-4026-bef2-ba3b40838318 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:26.096501 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dfc32d4f-b042-4026-bef2-ba3b40838318 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:26.103168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfc32d4f-b042-4026-bef2-ba3b40838318 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:26.103611 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfc32d4f-b042-4026-bef2-ba3b40838318 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:26.104358 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfc32d4f-b042-4026-bef2-ba3b40838318 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:26.104788 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfc32d4f-b042-4026-bef2-ba3b40838318 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:26.165789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dfc32d4f-b042-4026-bef2-ba3b40838318 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:26.174286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dfc32d4f-b042-4026-bef2-ba3b40838318 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082243 Jun 20 06:45:26.174843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1154/2241] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:26 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:26.697183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9dde31e6-1f6a-40fc-bd41-86d0e842a08c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:26.697767 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9dde31e6-1f6a-40fc-bd41-86d0e842a08c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:26.704924 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9dde31e6-1f6a-40fc-bd41-86d0e842a08c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:26.705368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9dde31e6-1f6a-40fc-bd41-86d0e842a08c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:26.706145 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9dde31e6-1f6a-40fc-bd41-86d0e842a08c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:26.706575 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9dde31e6-1f6a-40fc-bd41-86d0e842a08c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:26.766565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9dde31e6-1f6a-40fc-bd41-86d0e842a08c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:26.774428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9dde31e6-1f6a-40fc-bd41-86d0e842a08c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081276 Jun 20 06:45:26.774991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1088/2242] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:26 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:27.191038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-560342d9-f061-4dba-930b-ce72e76a2606 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:27.191643 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-560342d9-f061-4dba-930b-ce72e76a2606 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:27.198057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-560342d9-f061-4dba-930b-ce72e76a2606 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:27.198495 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-560342d9-f061-4dba-930b-ce72e76a2606 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:27.199315 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-560342d9-f061-4dba-930b-ce72e76a2606 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:27.200070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-560342d9-f061-4dba-930b-ce72e76a2606 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:27.264407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-560342d9-f061-4dba-930b-ce72e76a2606 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:27.272003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-560342d9-f061-4dba-930b-ce72e76a2606 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084790 Jun 20 06:45:27.272594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1155/2243] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:27 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:27.791118 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8783031-75a4-4a2c-ab10-cad33813e294 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:27.791737 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8783031-75a4-4a2c-ab10-cad33813e294 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:27.798183 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8783031-75a4-4a2c-ab10-cad33813e294 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:27.798628 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8783031-75a4-4a2c-ab10-cad33813e294 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:27.799374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8783031-75a4-4a2c-ab10-cad33813e294 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:27.799803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8783031-75a4-4a2c-ab10-cad33813e294 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:27.859748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8783031-75a4-4a2c-ab10-cad33813e294 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:27.867695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8783031-75a4-4a2c-ab10-cad33813e294 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080403 Jun 20 06:45:27.868274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1089/2244] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:27 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:28.287958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e131b509-0de0-4f6b-a3c6-d7a702e941e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:28.288563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e131b509-0de0-4f6b-a3c6-d7a702e941e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:28.295109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e131b509-0de0-4f6b-a3c6-d7a702e941e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:28.295553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e131b509-0de0-4f6b-a3c6-d7a702e941e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:28.296302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e131b509-0de0-4f6b-a3c6-d7a702e941e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:28.296728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e131b509-0de0-4f6b-a3c6-d7a702e941e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:28.358047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e131b509-0de0-4f6b-a3c6-d7a702e941e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:28.365575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e131b509-0de0-4f6b-a3c6-d7a702e941e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081428 Jun 20 06:45:28.366138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1156/2245] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:28 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:28.885107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c3f83541-18e1-4ac7-ad74-e9221895de0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:28.885784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c3f83541-18e1-4ac7-ad74-e9221895de0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:28.892553 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3f83541-18e1-4ac7-ad74-e9221895de0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:28.892999 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3f83541-18e1-4ac7-ad74-e9221895de0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:28.893785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3f83541-18e1-4ac7-ad74-e9221895de0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:28.894216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3f83541-18e1-4ac7-ad74-e9221895de0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:28.955976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c3f83541-18e1-4ac7-ad74-e9221895de0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:28.963678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c3f83541-18e1-4ac7-ad74-e9221895de0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082391 Jun 20 06:45:28.964233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1090/2246] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:28 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:29.383728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bf35bddf-1414-49c8-9f60-35baac5c5f9a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:29.384339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bf35bddf-1414-49c8-9f60-35baac5c5f9a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:29.391585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf35bddf-1414-49c8-9f60-35baac5c5f9a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:29.391972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf35bddf-1414-49c8-9f60-35baac5c5f9a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:29.392747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf35bddf-1414-49c8-9f60-35baac5c5f9a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:29.393185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bf35bddf-1414-49c8-9f60-35baac5c5f9a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:29.458307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bf35bddf-1414-49c8-9f60-35baac5c5f9a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:29.466342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bf35bddf-1414-49c8-9f60-35baac5c5f9a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086550 Jun 20 06:45:29.466906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1157/2247] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:29 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:29.981890 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-67a925de-18b0-4298-a873-fb2944a40ce4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:29.982549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-67a925de-18b0-4298-a873-fb2944a40ce4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:29.988966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67a925de-18b0-4298-a873-fb2944a40ce4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:29.989456 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67a925de-18b0-4298-a873-fb2944a40ce4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:29.990222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67a925de-18b0-4298-a873-fb2944a40ce4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:29.990662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-67a925de-18b0-4298-a873-fb2944a40ce4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:30.051104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-67a925de-18b0-4298-a873-fb2944a40ce4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:30.059586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-67a925de-18b0-4298-a873-fb2944a40ce4 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081691 Jun 20 06:45:30.060140 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1091/2248] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:29 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:30.483782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bace39ca-fd56-4245-b459-4b9819e24d3c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:30.484391 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bace39ca-fd56-4245-b459-4b9819e24d3c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:30.490860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bace39ca-fd56-4245-b459-4b9819e24d3c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:30.491298 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bace39ca-fd56-4245-b459-4b9819e24d3c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:30.492046 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bace39ca-fd56-4245-b459-4b9819e24d3c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:30.492473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bace39ca-fd56-4245-b459-4b9819e24d3c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:30.552829 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bace39ca-fd56-4245-b459-4b9819e24d3c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:30.560244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bace39ca-fd56-4245-b459-4b9819e24d3c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080967 Jun 20 06:45:30.560793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1158/2249] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:30 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:31.076136 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-58bc1d0d-fbac-475f-a01a-eb1ba63dcafa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:31.076775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-58bc1d0d-fbac-475f-a01a-eb1ba63dcafa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:31.083218 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58bc1d0d-fbac-475f-a01a-eb1ba63dcafa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:31.083668 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58bc1d0d-fbac-475f-a01a-eb1ba63dcafa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:31.084421 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58bc1d0d-fbac-475f-a01a-eb1ba63dcafa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:31.084856 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-58bc1d0d-fbac-475f-a01a-eb1ba63dcafa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:31.145398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-58bc1d0d-fbac-475f-a01a-eb1ba63dcafa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:31.153730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-58bc1d0d-fbac-475f-a01a-eb1ba63dcafa tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082087 Jun 20 06:45:31.154300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1092/2250] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:31 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:31.576907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5b81e7f9-8a2d-4f45-bb1b-37d1e6b0ffd0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:31.577565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5b81e7f9-8a2d-4f45-bb1b-37d1e6b0ffd0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:31.584012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5b81e7f9-8a2d-4f45-bb1b-37d1e6b0ffd0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:31.584396 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5b81e7f9-8a2d-4f45-bb1b-37d1e6b0ffd0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:31.585143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5b81e7f9-8a2d-4f45-bb1b-37d1e6b0ffd0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:31.585606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5b81e7f9-8a2d-4f45-bb1b-37d1e6b0ffd0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:31.648958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5b81e7f9-8a2d-4f45-bb1b-37d1e6b0ffd0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:31.656707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5b81e7f9-8a2d-4f45-bb1b-37d1e6b0ffd0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083702 Jun 20 06:45:31.657254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1159/2251] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:31 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:32.171266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-902877cd-3605-4c37-80cd-9e55486d2181 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:32.171911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-902877cd-3605-4c37-80cd-9e55486d2181 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:32.178706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-902877cd-3605-4c37-80cd-9e55486d2181 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:32.179101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-902877cd-3605-4c37-80cd-9e55486d2181 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:32.179866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-902877cd-3605-4c37-80cd-9e55486d2181 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:32.180302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-902877cd-3605-4c37-80cd-9e55486d2181 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:32.240612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-902877cd-3605-4c37-80cd-9e55486d2181 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:32.242817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:32.250196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-902877cd-3605-4c37-80cd-9e55486d2181 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083350 Jun 20 06:45:32.250831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1093/2252] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:32 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:32.672921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3128324c-e6ee-4255-b95a-e3703cb481fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:32.673546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3128324c-e6ee-4255-b95a-e3703cb481fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:32.680179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3128324c-e6ee-4255-b95a-e3703cb481fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:32.680626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3128324c-e6ee-4255-b95a-e3703cb481fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:32.681400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3128324c-e6ee-4255-b95a-e3703cb481fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:32.681834 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3128324c-e6ee-4255-b95a-e3703cb481fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:32.742406 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3128324c-e6ee-4255-b95a-e3703cb481fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:32.750485 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3128324c-e6ee-4255-b95a-e3703cb481fd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081419 Jun 20 06:45:32.751041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1160/2253] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:32 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:33.266965 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-baa7f375-2a0d-4180-b2a4-c21ec023c08e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:33.267517 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-baa7f375-2a0d-4180-b2a4-c21ec023c08e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:33.274154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-baa7f375-2a0d-4180-b2a4-c21ec023c08e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:33.274601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-baa7f375-2a0d-4180-b2a4-c21ec023c08e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:33.275351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-baa7f375-2a0d-4180-b2a4-c21ec023c08e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:33.275785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-baa7f375-2a0d-4180-b2a4-c21ec023c08e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:33.336752 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-baa7f375-2a0d-4180-b2a4-c21ec023c08e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:33.345213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-baa7f375-2a0d-4180-b2a4-c21ec023c08e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082126 Jun 20 06:45:33.345844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1094/2254] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:33 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:33.768272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2be35171-677f-4396-9c99-4b473fdd9354 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:33.768878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2be35171-677f-4396-9c99-4b473fdd9354 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:33.775099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2be35171-677f-4396-9c99-4b473fdd9354 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:33.775541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2be35171-677f-4396-9c99-4b473fdd9354 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:33.776285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2be35171-677f-4396-9c99-4b473fdd9354 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:33.776718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2be35171-677f-4396-9c99-4b473fdd9354 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:33.841716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2be35171-677f-4396-9c99-4b473fdd9354 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:33.849113 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2be35171-677f-4396-9c99-4b473fdd9354 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084713 Jun 20 06:45:33.849704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1161/2255] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:33 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:34.362332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-48ed3524-5983-4fd5-8ae1-bb145eb9e4ce tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:34.362944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-48ed3524-5983-4fd5-8ae1-bb145eb9e4ce tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:34.369349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48ed3524-5983-4fd5-8ae1-bb145eb9e4ce tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:34.369820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48ed3524-5983-4fd5-8ae1-bb145eb9e4ce tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:34.370570 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48ed3524-5983-4fd5-8ae1-bb145eb9e4ce tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:34.371663 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48ed3524-5983-4fd5-8ae1-bb145eb9e4ce tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:34.437997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-48ed3524-5983-4fd5-8ae1-bb145eb9e4ce tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:34.447300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-48ed3524-5983-4fd5-8ae1-bb145eb9e4ce tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.088742 Jun 20 06:45:34.447823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1095/2256] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:34 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:34.866038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6543e53b-d313-47f4-a0a6-beed2b1512cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:34.866732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6543e53b-d313-47f4-a0a6-beed2b1512cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:34.873509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6543e53b-d313-47f4-a0a6-beed2b1512cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:34.873956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6543e53b-d313-47f4-a0a6-beed2b1512cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:34.874728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6543e53b-d313-47f4-a0a6-beed2b1512cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:34.875159 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6543e53b-d313-47f4-a0a6-beed2b1512cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:34.941939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6543e53b-d313-47f4-a0a6-beed2b1512cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:34.950443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6543e53b-d313-47f4-a0a6-beed2b1512cd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.088267 Jun 20 06:45:34.951015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1162/2257] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:34 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:35.464639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0bd40369-c7f3-47b8-a8c9-4ee82d8e9b56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:35.465881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0bd40369-c7f3-47b8-a8c9-4ee82d8e9b56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:35.472279 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bd40369-c7f3-47b8-a8c9-4ee82d8e9b56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:35.472722 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bd40369-c7f3-47b8-a8c9-4ee82d8e9b56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:35.473499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bd40369-c7f3-47b8-a8c9-4ee82d8e9b56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:35.473934 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0bd40369-c7f3-47b8-a8c9-4ee82d8e9b56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:35.535901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0bd40369-c7f3-47b8-a8c9-4ee82d8e9b56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:35.543748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0bd40369-c7f3-47b8-a8c9-4ee82d8e9b56 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082993 Jun 20 06:45:35.544311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1096/2258] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:35 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:35.967362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f4e66d04-79d4-44c4-8983-343180ab5184 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:35.967998 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f4e66d04-79d4-44c4-8983-343180ab5184 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:35.974395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4e66d04-79d4-44c4-8983-343180ab5184 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:35.974837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4e66d04-79d4-44c4-8983-343180ab5184 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:35.975610 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4e66d04-79d4-44c4-8983-343180ab5184 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:35.976038 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f4e66d04-79d4-44c4-8983-343180ab5184 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:36.039387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f4e66d04-79d4-44c4-8983-343180ab5184 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:36.047303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f4e66d04-79d4-44c4-8983-343180ab5184 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083828 Jun 20 06:45:36.047847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1163/2259] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:35 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:36.561133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f7556a6-54e0-4a6b-a629-3e75f38f81d3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:36.561768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f7556a6-54e0-4a6b-a629-3e75f38f81d3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:36.568168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f7556a6-54e0-4a6b-a629-3e75f38f81d3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:36.568610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f7556a6-54e0-4a6b-a629-3e75f38f81d3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:36.569358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f7556a6-54e0-4a6b-a629-3e75f38f81d3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:36.569813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f7556a6-54e0-4a6b-a629-3e75f38f81d3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:36.630976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f7556a6-54e0-4a6b-a629-3e75f38f81d3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:36.639816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f7556a6-54e0-4a6b-a629-3e75f38f81d3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083045 Jun 20 06:45:36.640504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1097/2260] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:36 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:37.063969 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-75f24981-4bc8-41f0-afa4-4cad6b28ebf1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:37.064569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-75f24981-4bc8-41f0-afa4-4cad6b28ebf1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:37.071042 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75f24981-4bc8-41f0-afa4-4cad6b28ebf1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:37.071484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75f24981-4bc8-41f0-afa4-4cad6b28ebf1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:37.072225 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75f24981-4bc8-41f0-afa4-4cad6b28ebf1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:37.072650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75f24981-4bc8-41f0-afa4-4cad6b28ebf1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:37.132394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-75f24981-4bc8-41f0-afa4-4cad6b28ebf1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:37.140776 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-75f24981-4bc8-41f0-afa4-4cad6b28ebf1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080638 Jun 20 06:45:37.141325 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1164/2261] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:37 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:37.657335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0f6f9b4-4929-4252-986a-5837ed36fb02 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:37.658230 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a0f6f9b4-4929-4252-986a-5837ed36fb02 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:37.664956 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0f6f9b4-4929-4252-986a-5837ed36fb02 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:37.665426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0f6f9b4-4929-4252-986a-5837ed36fb02 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:37.666185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0f6f9b4-4929-4252-986a-5837ed36fb02 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:37.666618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0f6f9b4-4929-4252-986a-5837ed36fb02 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:37.731736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0f6f9b4-4929-4252-986a-5837ed36fb02 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:37.740021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a0f6f9b4-4929-4252-986a-5837ed36fb02 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.087045 Jun 20 06:45:37.740581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1098/2262] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:37 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:38.158109 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ed0194bd-0c03-45fc-ae81-d4e9e1c7e964 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:38.158741 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ed0194bd-0c03-45fc-ae81-d4e9e1c7e964 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:38.165122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed0194bd-0c03-45fc-ae81-d4e9e1c7e964 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:38.165604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed0194bd-0c03-45fc-ae81-d4e9e1c7e964 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:38.166350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed0194bd-0c03-45fc-ae81-d4e9e1c7e964 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:38.166778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed0194bd-0c03-45fc-ae81-d4e9e1c7e964 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:38.230348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ed0194bd-0c03-45fc-ae81-d4e9e1c7e964 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:38.237724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ed0194bd-0c03-45fc-ae81-d4e9e1c7e964 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083463 Jun 20 06:45:38.238286 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1165/2263] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:38 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:38.759143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-47d00564-3a0d-4f06-8ee3-0109318bc98b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:38.759746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-47d00564-3a0d-4f06-8ee3-0109318bc98b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:38.767100 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47d00564-3a0d-4f06-8ee3-0109318bc98b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:38.767532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47d00564-3a0d-4f06-8ee3-0109318bc98b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:38.768274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47d00564-3a0d-4f06-8ee3-0109318bc98b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:38.768702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47d00564-3a0d-4f06-8ee3-0109318bc98b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:38.828630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-47d00564-3a0d-4f06-8ee3-0109318bc98b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:38.836442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-47d00564-3a0d-4f06-8ee3-0109318bc98b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081122 Jun 20 06:45:38.836995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1099/2264] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:38 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:39.254541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ed75180b-f3df-4b2c-8fcd-566c6672277f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:39.255151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ed75180b-f3df-4b2c-8fcd-566c6672277f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:39.261629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed75180b-f3df-4b2c-8fcd-566c6672277f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:39.262347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed75180b-f3df-4b2c-8fcd-566c6672277f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:39.263108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed75180b-f3df-4b2c-8fcd-566c6672277f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:39.263546 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed75180b-f3df-4b2c-8fcd-566c6672277f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:39.324174 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ed75180b-f3df-4b2c-8fcd-566c6672277f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:39.331900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ed75180b-f3df-4b2c-8fcd-566c6672277f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081169 Jun 20 06:45:39.332468 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1166/2265] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:39 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:39.853442 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fc15b9ad-c187-4fe3-8e24-03b82d534f94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:39.854078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fc15b9ad-c187-4fe3-8e24-03b82d534f94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:39.860736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc15b9ad-c187-4fe3-8e24-03b82d534f94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:39.861187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc15b9ad-c187-4fe3-8e24-03b82d534f94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:39.861994 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc15b9ad-c187-4fe3-8e24-03b82d534f94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:39.862430 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc15b9ad-c187-4fe3-8e24-03b82d534f94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:39.921869 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fc15b9ad-c187-4fe3-8e24-03b82d534f94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:39.929702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fc15b9ad-c187-4fe3-8e24-03b82d534f94 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080101 Jun 20 06:45:39.930287 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1100/2266] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:39 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:40.349144 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-64edccab-caa4-4db1-ba14-6fff68f5717b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:40.349785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-64edccab-caa4-4db1-ba14-6fff68f5717b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:40.356451 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64edccab-caa4-4db1-ba14-6fff68f5717b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:40.356915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64edccab-caa4-4db1-ba14-6fff68f5717b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:40.357689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64edccab-caa4-4db1-ba14-6fff68f5717b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:40.358121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64edccab-caa4-4db1-ba14-6fff68f5717b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:40.421256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-64edccab-caa4-4db1-ba14-6fff68f5717b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:40.428626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-64edccab-caa4-4db1-ba14-6fff68f5717b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083323 Jun 20 06:45:40.429182 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1167/2267] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:40 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:40.947172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-edd2df4c-582c-4a95-9a7d-1db048f91209 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:40.947759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-edd2df4c-582c-4a95-9a7d-1db048f91209 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:40.954428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edd2df4c-582c-4a95-9a7d-1db048f91209 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:40.954872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edd2df4c-582c-4a95-9a7d-1db048f91209 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:40.955627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edd2df4c-582c-4a95-9a7d-1db048f91209 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:40.956155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-edd2df4c-582c-4a95-9a7d-1db048f91209 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:41.256120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-edd2df4c-582c-4a95-9a7d-1db048f91209 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:41.264947 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-edd2df4c-582c-4a95-9a7d-1db048f91209 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.321607 Jun 20 06:45:41.265539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1101/2268] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:40 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:41.446162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1669faba-c2de-4a17-896e-8d4e3c3b7e93 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:41.446793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1669faba-c2de-4a17-896e-8d4e3c3b7e93 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:41.453887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1669faba-c2de-4a17-896e-8d4e3c3b7e93 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:41.454342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1669faba-c2de-4a17-896e-8d4e3c3b7e93 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:41.455111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1669faba-c2de-4a17-896e-8d4e3c3b7e93 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:41.455550 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1669faba-c2de-4a17-896e-8d4e3c3b7e93 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:41.459416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:41.517323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1669faba-c2de-4a17-896e-8d4e3c3b7e93 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:41.524732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1669faba-c2de-4a17-896e-8d4e3c3b7e93 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082397 Jun 20 06:45:41.525296 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1168/2269] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:41 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:42.282202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2da3e0ed-357b-46f4-9ab3-a1e211419387 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:42.282749 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2da3e0ed-357b-46f4-9ab3-a1e211419387 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:42.289483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2da3e0ed-357b-46f4-9ab3-a1e211419387 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:42.289929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2da3e0ed-357b-46f4-9ab3-a1e211419387 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:42.290681 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2da3e0ed-357b-46f4-9ab3-a1e211419387 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:42.291281 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2da3e0ed-357b-46f4-9ab3-a1e211419387 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:42.351787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2da3e0ed-357b-46f4-9ab3-a1e211419387 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:42.360515 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2da3e0ed-357b-46f4-9ab3-a1e211419387 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082806 Jun 20 06:45:42.361073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1102/2270] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:42 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:42.543216 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-64f37b84-a51e-4f39-bdf8-3903cb4e0203 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:42.543753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-64f37b84-a51e-4f39-bdf8-3903cb4e0203 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:42.551356 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64f37b84-a51e-4f39-bdf8-3903cb4e0203 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:42.551803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64f37b84-a51e-4f39-bdf8-3903cb4e0203 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:42.552554 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64f37b84-a51e-4f39-bdf8-3903cb4e0203 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:42.552988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-64f37b84-a51e-4f39-bdf8-3903cb4e0203 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:42.616068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-64f37b84-a51e-4f39-bdf8-3903cb4e0203 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:42.624023 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-64f37b84-a51e-4f39-bdf8-3903cb4e0203 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084793 Jun 20 06:45:42.624581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1169/2271] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:42 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:43.377504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bfa56f4-b3b2-4475-b6cc-cec6bdf659a3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:43.378111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7bfa56f4-b3b2-4475-b6cc-cec6bdf659a3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:43.384583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bfa56f4-b3b2-4475-b6cc-cec6bdf659a3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:43.385026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bfa56f4-b3b2-4475-b6cc-cec6bdf659a3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:43.385808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bfa56f4-b3b2-4475-b6cc-cec6bdf659a3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:43.386235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bfa56f4-b3b2-4475-b6cc-cec6bdf659a3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:43.452293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bfa56f4-b3b2-4475-b6cc-cec6bdf659a3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:43.460161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bfa56f4-b3b2-4475-b6cc-cec6bdf659a3 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.086504 Jun 20 06:45:43.460723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1103/2272] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:43 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:43.642022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-107ac60f-af58-4f05-bfc0-894af4524661 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:43.642630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-107ac60f-af58-4f05-bfc0-894af4524661 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:43.649069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-107ac60f-af58-4f05-bfc0-894af4524661 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:43.649561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-107ac60f-af58-4f05-bfc0-894af4524661 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:43.650312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-107ac60f-af58-4f05-bfc0-894af4524661 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:43.650747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-107ac60f-af58-4f05-bfc0-894af4524661 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:43.710883 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-107ac60f-af58-4f05-bfc0-894af4524661 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:43.718872 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-107ac60f-af58-4f05-bfc0-894af4524661 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081507 Jun 20 06:45:43.719434 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1170/2273] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:43 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:44.477450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8573489f-0ec3-4477-82f3-d1cc781a6264 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:44.478067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8573489f-0ec3-4477-82f3-d1cc781a6264 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:44.485068 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8573489f-0ec3-4477-82f3-d1cc781a6264 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:44.485575 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8573489f-0ec3-4477-82f3-d1cc781a6264 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:44.486351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8573489f-0ec3-4477-82f3-d1cc781a6264 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:44.486790 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8573489f-0ec3-4477-82f3-d1cc781a6264 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:44.547233 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8573489f-0ec3-4477-82f3-d1cc781a6264 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:44.554970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8573489f-0ec3-4477-82f3-d1cc781a6264 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081450 Jun 20 06:45:44.555532 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1104/2274] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:44 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:44.735721 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-60391ff2-823d-49e0-a704-208dc514265c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:44.736337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-60391ff2-823d-49e0-a704-208dc514265c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:44.742907 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-60391ff2-823d-49e0-a704-208dc514265c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:44.743357 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-60391ff2-823d-49e0-a704-208dc514265c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:44.744119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-60391ff2-823d-49e0-a704-208dc514265c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:44.744559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-60391ff2-823d-49e0-a704-208dc514265c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:44.804541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-60391ff2-823d-49e0-a704-208dc514265c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:44.812227 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-60391ff2-823d-49e0-a704-208dc514265c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081105 Jun 20 06:45:44.812790 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1171/2275] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:44 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:45.571899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a5006a1c-0050-4720-8556-c0e90d8c9628 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:45.572509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a5006a1c-0050-4720-8556-c0e90d8c9628 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:45.579556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5006a1c-0050-4720-8556-c0e90d8c9628 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:45.580004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5006a1c-0050-4720-8556-c0e90d8c9628 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:45.580757 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5006a1c-0050-4720-8556-c0e90d8c9628 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:45.581246 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a5006a1c-0050-4720-8556-c0e90d8c9628 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:45.644781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a5006a1c-0050-4720-8556-c0e90d8c9628 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:45.652893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a5006a1c-0050-4720-8556-c0e90d8c9628 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084861 Jun 20 06:45:45.653653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1105/2276] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:45 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:45.829101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-533b0f39-f4d4-4470-9711-e51cf6a48aad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:45.829725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-533b0f39-f4d4-4470-9711-e51cf6a48aad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:45.836129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-533b0f39-f4d4-4470-9711-e51cf6a48aad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:45.836517 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-533b0f39-f4d4-4470-9711-e51cf6a48aad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:45.837259 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-533b0f39-f4d4-4470-9711-e51cf6a48aad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:45.837710 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-533b0f39-f4d4-4470-9711-e51cf6a48aad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:45.897799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-533b0f39-f4d4-4470-9711-e51cf6a48aad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:45.905544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-533b0f39-f4d4-4470-9711-e51cf6a48aad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080457 Jun 20 06:45:45.906111 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1172/2277] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:45 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:46.669977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-22140766-3b80-43ac-8e13-6c843409160d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:46.670577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-22140766-3b80-43ac-8e13-6c843409160d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:46.677155 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-22140766-3b80-43ac-8e13-6c843409160d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:46.677634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-22140766-3b80-43ac-8e13-6c843409160d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:46.678389 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-22140766-3b80-43ac-8e13-6c843409160d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:46.678893 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-22140766-3b80-43ac-8e13-6c843409160d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:46.739197 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-22140766-3b80-43ac-8e13-6c843409160d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:46.747016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-22140766-3b80-43ac-8e13-6c843409160d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081024 Jun 20 06:45:46.747570 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1106/2278] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:46 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:46.922561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc8b4c61-56ec-426c-a4d2-fa1f9bcaf2e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:46.923251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc8b4c61-56ec-426c-a4d2-fa1f9bcaf2e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:46.929728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc8b4c61-56ec-426c-a4d2-fa1f9bcaf2e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:46.930179 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc8b4c61-56ec-426c-a4d2-fa1f9bcaf2e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:46.930961 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc8b4c61-56ec-426c-a4d2-fa1f9bcaf2e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:46.931379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc8b4c61-56ec-426c-a4d2-fa1f9bcaf2e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:46.991336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc8b4c61-56ec-426c-a4d2-fa1f9bcaf2e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:46.999324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc8b4c61-56ec-426c-a4d2-fa1f9bcaf2e3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081008 Jun 20 06:45:46.999914 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1173/2279] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:46 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:47.763859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-84840b57-de84-4187-874a-204f318b23f1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:47.764445 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-84840b57-de84-4187-874a-204f318b23f1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:47.766851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:47.772077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84840b57-de84-4187-874a-204f318b23f1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:47.772525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84840b57-de84-4187-874a-204f318b23f1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:47.773300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84840b57-de84-4187-874a-204f318b23f1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:47.773758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84840b57-de84-4187-874a-204f318b23f1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:47.841591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84840b57-de84-4187-874a-204f318b23f1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:47.849623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-84840b57-de84-4187-874a-204f318b23f1 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.089827 Jun 20 06:45:47.850303 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1107/2280] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:47 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:48.017500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1e062497-4f93-4f3c-9d80-794551a0b783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:48.018059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1e062497-4f93-4f3c-9d80-794551a0b783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:48.024070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e062497-4f93-4f3c-9d80-794551a0b783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:48.024588 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e062497-4f93-4f3c-9d80-794551a0b783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:48.025493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e062497-4f93-4f3c-9d80-794551a0b783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:48.025927 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1e062497-4f93-4f3c-9d80-794551a0b783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:48.088218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1e062497-4f93-4f3c-9d80-794551a0b783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:48.096587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1e062497-4f93-4f3c-9d80-794551a0b783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084403 Jun 20 06:45:48.097236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1174/2281] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:48 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:48.866974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-503a6b99-3b69-4f96-b7f7-a28a30d25fdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:48.867573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-503a6b99-3b69-4f96-b7f7-a28a30d25fdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:48.874384 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-503a6b99-3b69-4f96-b7f7-a28a30d25fdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:48.874833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-503a6b99-3b69-4f96-b7f7-a28a30d25fdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:48.875592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-503a6b99-3b69-4f96-b7f7-a28a30d25fdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:48.876028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-503a6b99-3b69-4f96-b7f7-a28a30d25fdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:48.937342 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-503a6b99-3b69-4f96-b7f7-a28a30d25fdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:48.945193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-503a6b99-3b69-4f96-b7f7-a28a30d25fdc tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082076 Jun 20 06:45:48.945787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1108/2282] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:48 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:49.112869 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c35e14e7-ae7a-4288-ab44-4b94d9420834 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:49.113514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c35e14e7-ae7a-4288-ab44-4b94d9420834 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:49.115785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=56 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:49.121155 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c35e14e7-ae7a-4288-ab44-4b94d9420834 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:49.121615 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c35e14e7-ae7a-4288-ab44-4b94d9420834 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:49.123015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c35e14e7-ae7a-4288-ab44-4b94d9420834 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:49.123435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c35e14e7-ae7a-4288-ab44-4b94d9420834 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:49.186738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c35e14e7-ae7a-4288-ab44-4b94d9420834 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:49.194363 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c35e14e7-ae7a-4288-ab44-4b94d9420834 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085382 Jun 20 06:45:49.194919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1175/2283] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:49 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:49.963160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-97b4bdf9-4bce-4109-b27f-fa376c41f93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:49.963751 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-97b4bdf9-4bce-4109-b27f-fa376c41f93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:49.970560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97b4bdf9-4bce-4109-b27f-fa376c41f93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:49.971024 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97b4bdf9-4bce-4109-b27f-fa376c41f93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:49.971805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97b4bdf9-4bce-4109-b27f-fa376c41f93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:49.972237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97b4bdf9-4bce-4109-b27f-fa376c41f93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:50.035759 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-97b4bdf9-4bce-4109-b27f-fa376c41f93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:50.043579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-97b4bdf9-4bce-4109-b27f-fa376c41f93f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084251 Jun 20 06:45:50.044311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1109/2284] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:49 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:50.211972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dfc2cc9b-845c-45fc-a8a6-209e1b63ca19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:50.212616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dfc2cc9b-845c-45fc-a8a6-209e1b63ca19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:50.220031 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfc2cc9b-845c-45fc-a8a6-209e1b63ca19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:50.220508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfc2cc9b-845c-45fc-a8a6-209e1b63ca19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:50.221278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfc2cc9b-845c-45fc-a8a6-209e1b63ca19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:50.221756 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dfc2cc9b-845c-45fc-a8a6-209e1b63ca19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:50.282944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dfc2cc9b-845c-45fc-a8a6-209e1b63ca19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:50.290337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dfc2cc9b-845c-45fc-a8a6-209e1b63ca19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082199 Jun 20 06:45:50.290891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1176/2285] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:50 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:51.060581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5fb42928-5e38-45b9-b4df-1dad5ea698d6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:51.061186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5fb42928-5e38-45b9-b4df-1dad5ea698d6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:51.067589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fb42928-5e38-45b9-b4df-1dad5ea698d6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:51.068032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fb42928-5e38-45b9-b4df-1dad5ea698d6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:51.068781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fb42928-5e38-45b9-b4df-1dad5ea698d6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:51.069211 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fb42928-5e38-45b9-b4df-1dad5ea698d6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:51.085649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:51.132372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fb42928-5e38-45b9-b4df-1dad5ea698d6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:51.140666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5fb42928-5e38-45b9-b4df-1dad5ea698d6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084523 Jun 20 06:45:51.141221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1110/2286] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:51 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:51.307134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8feafe0d-0feb-40e2-b0a7-ab81a6581a19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:51.307663 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8feafe0d-0feb-40e2-b0a7-ab81a6581a19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:51.314138 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8feafe0d-0feb-40e2-b0a7-ab81a6581a19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:51.314582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8feafe0d-0feb-40e2-b0a7-ab81a6581a19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:51.315337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8feafe0d-0feb-40e2-b0a7-ab81a6581a19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:51.315764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8feafe0d-0feb-40e2-b0a7-ab81a6581a19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:51.379338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8feafe0d-0feb-40e2-b0a7-ab81a6581a19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:51.386736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8feafe0d-0feb-40e2-b0a7-ab81a6581a19 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083469 Jun 20 06:45:51.387682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1177/2287] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:51 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:52.157885 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee544bc6-1eb9-4861-9931-a4e8ce5964d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:52.158490 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee544bc6-1eb9-4861-9931-a4e8ce5964d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:52.164858 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee544bc6-1eb9-4861-9931-a4e8ce5964d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:52.165300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee544bc6-1eb9-4861-9931-a4e8ce5964d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:52.166077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee544bc6-1eb9-4861-9931-a4e8ce5964d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:52.166508 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee544bc6-1eb9-4861-9931-a4e8ce5964d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:52.232158 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ee544bc6-1eb9-4861-9931-a4e8ce5964d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:52.240469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee544bc6-1eb9-4861-9931-a4e8ce5964d0 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.086645 Jun 20 06:45:52.241030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1111/2288] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:52 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:52.405070 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8fdb5bd2-06af-46a1-b2d1-e8b8f3570a58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:52.405701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8fdb5bd2-06af-46a1-b2d1-e8b8f3570a58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:52.412188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8fdb5bd2-06af-46a1-b2d1-e8b8f3570a58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:52.412582 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8fdb5bd2-06af-46a1-b2d1-e8b8f3570a58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:52.413333 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8fdb5bd2-06af-46a1-b2d1-e8b8f3570a58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:52.413793 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8fdb5bd2-06af-46a1-b2d1-e8b8f3570a58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:52.473533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8fdb5bd2-06af-46a1-b2d1-e8b8f3570a58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:52.480963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8fdb5bd2-06af-46a1-b2d1-e8b8f3570a58 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080754 Jun 20 06:45:52.482031 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1178/2289] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:52 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:53.258982 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0e18b361-8f4e-42cf-b1e8-c34d72317ed9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:53.259521 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0e18b361-8f4e-42cf-b1e8-c34d72317ed9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:53.267163 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e18b361-8f4e-42cf-b1e8-c34d72317ed9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:53.267615 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e18b361-8f4e-42cf-b1e8-c34d72317ed9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:53.268505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e18b361-8f4e-42cf-b1e8-c34d72317ed9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:53.268977 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0e18b361-8f4e-42cf-b1e8-c34d72317ed9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:53.331715 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0e18b361-8f4e-42cf-b1e8-c34d72317ed9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:53.339084 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0e18b361-8f4e-42cf-b1e8-c34d72317ed9 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084962 Jun 20 06:45:53.339637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1112/2290] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:53 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:53.497551 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ce293597-2943-4800-9d9e-e7a587e7549c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:53.498147 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ce293597-2943-4800-9d9e-e7a587e7549c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:53.504565 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce293597-2943-4800-9d9e-e7a587e7549c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:53.505015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce293597-2943-4800-9d9e-e7a587e7549c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:53.505826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce293597-2943-4800-9d9e-e7a587e7549c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:53.506260 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce293597-2943-4800-9d9e-e7a587e7549c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:53.566168 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ce293597-2943-4800-9d9e-e7a587e7549c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:53.573783 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ce293597-2943-4800-9d9e-e7a587e7549c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080252 Jun 20 06:45:53.574348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1179/2291] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:53 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:54.356933 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8e0be7cc-1788-4951-bbcc-e1d509eeffea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:54.357647 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8e0be7cc-1788-4951-bbcc-e1d509eeffea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:54.364104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e0be7cc-1788-4951-bbcc-e1d509eeffea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:54.364558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e0be7cc-1788-4951-bbcc-e1d509eeffea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:54.365353 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e0be7cc-1788-4951-bbcc-e1d509eeffea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:54.365833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e0be7cc-1788-4951-bbcc-e1d509eeffea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:54.430128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8e0be7cc-1788-4951-bbcc-e1d509eeffea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:54.438165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8e0be7cc-1788-4951-bbcc-e1d509eeffea tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.085856 Jun 20 06:45:54.438727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1113/2292] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:54 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:54.591754 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4a63e14c-825e-44ab-9df8-91104af4582f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:54.592291 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4a63e14c-825e-44ab-9df8-91104af4582f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:54.598804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a63e14c-825e-44ab-9df8-91104af4582f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:54.599284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a63e14c-825e-44ab-9df8-91104af4582f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:54.600010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a63e14c-825e-44ab-9df8-91104af4582f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:54.600443 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a63e14c-825e-44ab-9df8-91104af4582f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:54.661511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a63e14c-825e-44ab-9df8-91104af4582f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:54.668900 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4a63e14c-825e-44ab-9df8-91104af4582f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081803 Jun 20 06:45:54.669487 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1180/2293] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:54 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:55.455086 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-99c34c4d-efe0-49cd-ac8a-86baf91600fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:55.455690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-99c34c4d-efe0-49cd-ac8a-86baf91600fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:55.462156 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99c34c4d-efe0-49cd-ac8a-86baf91600fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:55.462599 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99c34c4d-efe0-49cd-ac8a-86baf91600fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:55.463347 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99c34c4d-efe0-49cd-ac8a-86baf91600fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:55.463778 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-99c34c4d-efe0-49cd-ac8a-86baf91600fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:55.524029 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-99c34c4d-efe0-49cd-ac8a-86baf91600fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:55.531867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-99c34c4d-efe0-49cd-ac8a-86baf91600fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080607 Jun 20 06:45:55.532425 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1114/2294] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:55 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:55.686302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3c20891f-f2ab-4279-8d1a-cf42adcc9f56 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:55.686892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3c20891f-f2ab-4279-8d1a-cf42adcc9f56 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:55.693404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c20891f-f2ab-4279-8d1a-cf42adcc9f56 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:55.693864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c20891f-f2ab-4279-8d1a-cf42adcc9f56 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:55.694620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c20891f-f2ab-4279-8d1a-cf42adcc9f56 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:55.695059 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c20891f-f2ab-4279-8d1a-cf42adcc9f56 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:55.757592 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3c20891f-f2ab-4279-8d1a-cf42adcc9f56 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:55.765742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3c20891f-f2ab-4279-8d1a-cf42adcc9f56 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084035 Jun 20 06:45:55.766297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1181/2295] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:55 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:56.548617 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63218a91-d095-4028-a0d8-4a1c1b17b089 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:56.549222 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63218a91-d095-4028-a0d8-4a1c1b17b089 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:56.555672 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63218a91-d095-4028-a0d8-4a1c1b17b089 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:56.556111 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63218a91-d095-4028-a0d8-4a1c1b17b089 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:56.556857 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63218a91-d095-4028-a0d8-4a1c1b17b089 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:56.557285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63218a91-d095-4028-a0d8-4a1c1b17b089 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:56.620902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-63218a91-d095-4028-a0d8-4a1c1b17b089 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:56.629660 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-63218a91-d095-4028-a0d8-4a1c1b17b089 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084903 Jun 20 06:45:56.630221 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1115/2296] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:56 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:45:56.783303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d23030f-b791-4920-ae2b-2f07ff7974d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:56.783948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6d23030f-b791-4920-ae2b-2f07ff7974d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:56.790403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d23030f-b791-4920-ae2b-2f07ff7974d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:56.790855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d23030f-b791-4920-ae2b-2f07ff7974d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:56.791613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d23030f-b791-4920-ae2b-2f07ff7974d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:56.792052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d23030f-b791-4920-ae2b-2f07ff7974d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:56.852962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6d23030f-b791-4920-ae2b-2f07ff7974d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:56.860416 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6d23030f-b791-4920-ae2b-2f07ff7974d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081252 Jun 20 06:45:56.860988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1182/2297] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:56 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:45:57.647359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-00005f45-5d07-4622-9d17-7a34a5dafaac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:57.647988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-00005f45-5d07-4622-9d17-7a34a5dafaac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:57.654483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-00005f45-5d07-4622-9d17-7a34a5dafaac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:57.654936 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-00005f45-5d07-4622-9d17-7a34a5dafaac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:57.655698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-00005f45-5d07-4622-9d17-7a34a5dafaac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:57.656142 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-00005f45-5d07-4622-9d17-7a34a5dafaac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:57.719004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-00005f45-5d07-4622-9d17-7a34a5dafaac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:57.726707 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-00005f45-5d07-4622-9d17-7a34a5dafaac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083212 Jun 20 06:45:57.727263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1116/2298] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:57 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:57.877675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-296bcf40-9e54-4c63-b9e2-f480eae7bddd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:57.878313 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-296bcf40-9e54-4c63-b9e2-f480eae7bddd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:57.884641 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-296bcf40-9e54-4c63-b9e2-f480eae7bddd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:57.885082 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-296bcf40-9e54-4c63-b9e2-f480eae7bddd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:57.885864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-296bcf40-9e54-4c63-b9e2-f480eae7bddd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:57.886288 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-296bcf40-9e54-4c63-b9e2-f480eae7bddd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:57.950152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-296bcf40-9e54-4c63-b9e2-f480eae7bddd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:57.957347 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-296bcf40-9e54-4c63-b9e2-f480eae7bddd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083545 Jun 20 06:45:57.957921 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1183/2299] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:57 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:58.743812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a3600083-434d-4306-be17-c4204a1cf0ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:58.744447 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a3600083-434d-4306-be17-c4204a1cf0ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:58.751172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3600083-434d-4306-be17-c4204a1cf0ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:58.751613 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3600083-434d-4306-be17-c4204a1cf0ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:58.752365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3600083-434d-4306-be17-c4204a1cf0ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:58.752792 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3600083-434d-4306-be17-c4204a1cf0ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:58.818005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a3600083-434d-4306-be17-c4204a1cf0ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:58.827516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a3600083-434d-4306-be17-c4204a1cf0ca tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.087498 Jun 20 06:45:58.836676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1117/2300] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:58 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:58.974135 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0c3405e5-5c5a-4b39-81f6-c98da0a6643f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:58.975409 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0c3405e5-5c5a-4b39-81f6-c98da0a6643f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:58.982424 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c3405e5-5c5a-4b39-81f6-c98da0a6643f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:58.982944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c3405e5-5c5a-4b39-81f6-c98da0a6643f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:58.983838 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c3405e5-5c5a-4b39-81f6-c98da0a6643f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:58.984208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c3405e5-5c5a-4b39-81f6-c98da0a6643f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:59.047768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0c3405e5-5c5a-4b39-81f6-c98da0a6643f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:59.050065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:45:59.056867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0c3405e5-5c5a-4b39-81f6-c98da0a6643f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086533 Jun 20 06:45:59.057466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1184/2301] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:58 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:45:59.844844 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-07ed1aca-e09b-4923-894b-9488ca4f9cd6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:45:59.845461 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-07ed1aca-e09b-4923-894b-9488ca4f9cd6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:45:59.853086 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07ed1aca-e09b-4923-894b-9488ca4f9cd6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:59.853940 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07ed1aca-e09b-4923-894b-9488ca4f9cd6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:59.855275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07ed1aca-e09b-4923-894b-9488ca4f9cd6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:45:59.856731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07ed1aca-e09b-4923-894b-9488ca4f9cd6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:45:59.917501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-07ed1aca-e09b-4923-894b-9488ca4f9cd6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:45:59.925847 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-07ed1aca-e09b-4923-894b-9488ca4f9cd6 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.085501 Jun 20 06:45:59.926419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1118/2302] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:45:59 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:00.074236 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b2b9ad88-1a41-4936-8452-0734a26e9ae5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:00.075545 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b2b9ad88-1a41-4936-8452-0734a26e9ae5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:00.081976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b2b9ad88-1a41-4936-8452-0734a26e9ae5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:00.082428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b2b9ad88-1a41-4936-8452-0734a26e9ae5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:00.083181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b2b9ad88-1a41-4936-8452-0734a26e9ae5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:00.083616 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b2b9ad88-1a41-4936-8452-0734a26e9ae5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:00.145404 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b2b9ad88-1a41-4936-8452-0734a26e9ae5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:00.153619 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b2b9ad88-1a41-4936-8452-0734a26e9ae5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082461 Jun 20 06:46:00.154101 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1185/2303] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:00 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:00.942469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7c7f3e7b-6774-42ee-a0a6-dfb0ac6b729a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:00.943081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7c7f3e7b-6774-42ee-a0a6-dfb0ac6b729a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:00.950441 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c7f3e7b-6774-42ee-a0a6-dfb0ac6b729a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:00.950922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c7f3e7b-6774-42ee-a0a6-dfb0ac6b729a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:00.951691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c7f3e7b-6774-42ee-a0a6-dfb0ac6b729a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:00.952130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7c7f3e7b-6774-42ee-a0a6-dfb0ac6b729a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:01.016382 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7c7f3e7b-6774-42ee-a0a6-dfb0ac6b729a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:01.024527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7c7f3e7b-6774-42ee-a0a6-dfb0ac6b729a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.085928 Jun 20 06:46:01.025083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1119/2304] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:00 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:01.170417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-46d12592-25d0-4b1d-99f7-36541b6c741d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:01.171057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-46d12592-25d0-4b1d-99f7-36541b6c741d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:01.177484 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46d12592-25d0-4b1d-99f7-36541b6c741d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:01.177927 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46d12592-25d0-4b1d-99f7-36541b6c741d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:01.178673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46d12592-25d0-4b1d-99f7-36541b6c741d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:01.179099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46d12592-25d0-4b1d-99f7-36541b6c741d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:01.239988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-46d12592-25d0-4b1d-99f7-36541b6c741d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:01.248078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-46d12592-25d0-4b1d-99f7-36541b6c741d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081452 Jun 20 06:46:01.248664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1186/2305] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:01 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:02.041815 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-30839960-f592-4c21-a386-5ba08b48b234 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:02.042428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-30839960-f592-4c21-a386-5ba08b48b234 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:02.049669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30839960-f592-4c21-a386-5ba08b48b234 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:02.050122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30839960-f592-4c21-a386-5ba08b48b234 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:02.050881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30839960-f592-4c21-a386-5ba08b48b234 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:02.051322 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30839960-f592-4c21-a386-5ba08b48b234 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:02.111286 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-30839960-f592-4c21-a386-5ba08b48b234 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:02.119096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-30839960-f592-4c21-a386-5ba08b48b234 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081093 Jun 20 06:46:02.119659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1120/2306] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:02 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:02.265698 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4c0cd43a-03d4-452b-9ab0-b0d94fda8b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:02.266513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4c0cd43a-03d4-452b-9ab0-b0d94fda8b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:02.272931 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c0cd43a-03d4-452b-9ab0-b0d94fda8b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:02.273393 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c0cd43a-03d4-452b-9ab0-b0d94fda8b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:02.274153 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c0cd43a-03d4-452b-9ab0-b0d94fda8b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:02.274583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c0cd43a-03d4-452b-9ab0-b0d94fda8b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:02.335100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4c0cd43a-03d4-452b-9ab0-b0d94fda8b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:02.343808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4c0cd43a-03d4-452b-9ab0-b0d94fda8b7a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082750 Jun 20 06:46:02.344362 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1187/2307] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:02 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:03.135762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-921c77c9-85a4-4971-866f-18f01863f1d2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:03.136369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-921c77c9-85a4-4971-866f-18f01863f1d2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:03.143095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-921c77c9-85a4-4971-866f-18f01863f1d2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:03.143539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-921c77c9-85a4-4971-866f-18f01863f1d2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:03.144298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-921c77c9-85a4-4971-866f-18f01863f1d2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:03.144727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-921c77c9-85a4-4971-866f-18f01863f1d2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:03.207182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-921c77c9-85a4-4971-866f-18f01863f1d2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:03.215006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-921c77c9-85a4-4971-866f-18f01863f1d2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.083153 Jun 20 06:46:03.215629 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1121/2308] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:03 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:03.360988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-18e0856b-7872-4d2f-b06a-57dcec9c8dad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:03.361625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-18e0856b-7872-4d2f-b06a-57dcec9c8dad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:03.367803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18e0856b-7872-4d2f-b06a-57dcec9c8dad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:03.368251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18e0856b-7872-4d2f-b06a-57dcec9c8dad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:03.369001 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18e0856b-7872-4d2f-b06a-57dcec9c8dad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:03.369453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18e0856b-7872-4d2f-b06a-57dcec9c8dad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:03.430796 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-18e0856b-7872-4d2f-b06a-57dcec9c8dad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:03.438278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-18e0856b-7872-4d2f-b06a-57dcec9c8dad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081200 Jun 20 06:46:03.438841 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1188/2309] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:03 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:04.231284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f5029083-3408-419f-9712-f3ef12f476ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:04.231942 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f5029083-3408-419f-9712-f3ef12f476ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:04.238340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f5029083-3408-419f-9712-f3ef12f476ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:04.238785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f5029083-3408-419f-9712-f3ef12f476ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:04.239537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f5029083-3408-419f-9712-f3ef12f476ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:04.239969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f5029083-3408-419f-9712-f3ef12f476ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:04.303204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f5029083-3408-419f-9712-f3ef12f476ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:04.311907 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f5029083-3408-419f-9712-f3ef12f476ba tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084471 Jun 20 06:46:04.312463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1122/2310] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:04 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:04.455027 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-670c8ac2-930e-4877-97df-ab4beb6f4b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:04.455635 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-670c8ac2-930e-4877-97df-ab4beb6f4b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:04.462036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-670c8ac2-930e-4877-97df-ab4beb6f4b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:04.462483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-670c8ac2-930e-4877-97df-ab4beb6f4b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:04.463235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-670c8ac2-930e-4877-97df-ab4beb6f4b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:04.463661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-670c8ac2-930e-4877-97df-ab4beb6f4b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:04.523862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-670c8ac2-930e-4877-97df-ab4beb6f4b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:04.531314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-670c8ac2-930e-4877-97df-ab4beb6f4b37 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080168 Jun 20 06:46:04.531866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1189/2311] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:04 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:05.329090 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-88b86344-a75f-4ba3-abb5-b5fcf905abac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:05.329723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-88b86344-a75f-4ba3-abb5-b5fcf905abac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:05.336154 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88b86344-a75f-4ba3-abb5-b5fcf905abac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:05.336606 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88b86344-a75f-4ba3-abb5-b5fcf905abac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:05.337370 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88b86344-a75f-4ba3-abb5-b5fcf905abac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:05.337832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-88b86344-a75f-4ba3-abb5-b5fcf905abac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:05.409216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-88b86344-a75f-4ba3-abb5-b5fcf905abac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:05.417129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-88b86344-a75f-4ba3-abb5-b5fcf905abac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.092685 Jun 20 06:46:05.417723 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1123/2312] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:05 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:05.547806 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d7a040ad-025c-4b1b-a920-19eaab4372fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:05.548472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d7a040ad-025c-4b1b-a920-19eaab4372fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:05.554934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7a040ad-025c-4b1b-a920-19eaab4372fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:05.555387 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7a040ad-025c-4b1b-a920-19eaab4372fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:05.556177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7a040ad-025c-4b1b-a920-19eaab4372fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:05.556625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7a040ad-025c-4b1b-a920-19eaab4372fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:05.616752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7a040ad-025c-4b1b-a920-19eaab4372fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:05.624711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d7a040ad-025c-4b1b-a920-19eaab4372fa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080884 Jun 20 06:46:05.625282 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1190/2313] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:05 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:06.434319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3ebb5a79-3805-4b87-87e7-df0fcc316e49 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:06.435030 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3ebb5a79-3805-4b87-87e7-df0fcc316e49 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:06.441530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ebb5a79-3805-4b87-87e7-df0fcc316e49 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:06.441983 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ebb5a79-3805-4b87-87e7-df0fcc316e49 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:06.442741 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ebb5a79-3805-4b87-87e7-df0fcc316e49 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:06.443176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ebb5a79-3805-4b87-87e7-df0fcc316e49 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:06.503620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3ebb5a79-3805-4b87-87e7-df0fcc316e49 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:06.511378 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3ebb5a79-3805-4b87-87e7-df0fcc316e49 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.080928 Jun 20 06:46:06.512358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1124/2314] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:06 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:06.642253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e1718866-1808-4280-a585-5a39c7219f7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:06.642858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e1718866-1808-4280-a585-5a39c7219f7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:06.649332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1718866-1808-4280-a585-5a39c7219f7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:06.649803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1718866-1808-4280-a585-5a39c7219f7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:06.650549 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1718866-1808-4280-a585-5a39c7219f7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:06.650976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1718866-1808-4280-a585-5a39c7219f7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:06.710577 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e1718866-1808-4280-a585-5a39c7219f7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:06.719222 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e1718866-1808-4280-a585-5a39c7219f7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080956 Jun 20 06:46:06.719801 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1191/2315] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:06 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:07.528476 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c623cc8-850f-4e71-89da-d0c20f0441dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:07.529078 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c623cc8-850f-4e71-89da-d0c20f0441dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:07.535561 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c623cc8-850f-4e71-89da-d0c20f0441dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:07.536010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c623cc8-850f-4e71-89da-d0c20f0441dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:07.536762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c623cc8-850f-4e71-89da-d0c20f0441dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:07.537198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c623cc8-850f-4e71-89da-d0c20f0441dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:07.599805 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c623cc8-850f-4e71-89da-d0c20f0441dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:07.609187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c623cc8-850f-4e71-89da-d0c20f0441dd tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.084682 Jun 20 06:46:07.609775 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1125/2316] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:07 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:07.736377 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5a3f1a21-db0a-4306-ba0f-ace046c9bd66 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:07.736980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5a3f1a21-db0a-4306-ba0f-ace046c9bd66 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:07.743415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a3f1a21-db0a-4306-ba0f-ace046c9bd66 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:07.743855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a3f1a21-db0a-4306-ba0f-ace046c9bd66 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:07.744606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a3f1a21-db0a-4306-ba0f-ace046c9bd66 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:07.745040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a3f1a21-db0a-4306-ba0f-ace046c9bd66 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:07.805745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a3f1a21-db0a-4306-ba0f-ace046c9bd66 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:07.813139 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5a3f1a21-db0a-4306-ba0f-ace046c9bd66 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080530 Jun 20 06:46:07.813736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1192/2317] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:07 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:46:08.626849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0f4e7ff3-d58a-4896-aa06-7a406df9378a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:08.627396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0f4e7ff3-d58a-4896-aa06-7a406df9378a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:08.633839 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ff3-d58a-4896-aa06-7a406df9378a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:08.634293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ff3-d58a-4896-aa06-7a406df9378a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:08.635048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ff3-d58a-4896-aa06-7a406df9378a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:08.635482 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ff3-d58a-4896-aa06-7a406df9378a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:08.696727 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0f4e7ff3-d58a-4896-aa06-7a406df9378a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:08.705223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0f4e7ff3-d58a-4896-aa06-7a406df9378a tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.082370 Jun 20 06:46:08.705809 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1126/2318] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:08 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:46:08.830076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0c427c09-c160-46b8-ad00-a1652c55d5d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:08.830816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0c427c09-c160-46b8-ad00-a1652c55d5d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:08.837165 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c427c09-c160-46b8-ad00-a1652c55d5d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:08.837646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c427c09-c160-46b8-ad00-a1652c55d5d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:08.838389 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c427c09-c160-46b8-ad00-a1652c55d5d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:08.838817 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0c427c09-c160-46b8-ad00-a1652c55d5d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:08.900541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0c427c09-c160-46b8-ad00-a1652c55d5d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:08.908191 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0c427c09-c160-46b8-ad00-a1652c55d5d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081990 Jun 20 06:46:08.908753 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1193/2319] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:08 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:46:09.721969 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e98653ed-8537-4ec9-9022-1f550c568449 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:09.722579 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e98653ed-8537-4ec9-9022-1f550c568449 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:09.729081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e98653ed-8537-4ec9-9022-1f550c568449 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:09.729565 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e98653ed-8537-4ec9-9022-1f550c568449 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:09.730325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e98653ed-8537-4ec9-9022-1f550c568449 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:09.730763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e98653ed-8537-4ec9-9022-1f550c568449 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:09.734581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:09.795855 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e98653ed-8537-4ec9-9022-1f550c568449 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:09.803731 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e98653ed-8537-4ec9-9022-1f550c568449 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.085565 Jun 20 06:46:09.804293 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1127/2320] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:09 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:09.924775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4f5b9240-e8cc-483d-a2d0-6c26363eb575 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:09.925413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4f5b9240-e8cc-483d-a2d0-6c26363eb575 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:09.931768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f5b9240-e8cc-483d-a2d0-6c26363eb575 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:09.932218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f5b9240-e8cc-483d-a2d0-6c26363eb575 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:09.932972 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f5b9240-e8cc-483d-a2d0-6c26363eb575 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:09.933461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f5b9240-e8cc-483d-a2d0-6c26363eb575 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:09.995019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4f5b9240-e8cc-483d-a2d0-6c26363eb575 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:10.002642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4f5b9240-e8cc-483d-a2d0-6c26363eb575 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081687 Jun 20 06:46:10.003202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1194/2321] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:09 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:10.820007 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ffce005b-f5b5-4220-9505-0c3b46aa1d63 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:10.820618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ffce005b-f5b5-4220-9505-0c3b46aa1d63 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:10.827306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffce005b-f5b5-4220-9505-0c3b46aa1d63 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:10.827750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffce005b-f5b5-4220-9505-0c3b46aa1d63 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:10.828501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffce005b-f5b5-4220-9505-0c3b46aa1d63 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:10.828935 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffce005b-f5b5-4220-9505-0c3b46aa1d63 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:10.889630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ffce005b-f5b5-4220-9505-0c3b46aa1d63 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:10.897288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ffce005b-f5b5-4220-9505-0c3b46aa1d63 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.081155 Jun 20 06:46:10.897868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1128/2322] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:10 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:11.020141 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4575bd2f-bae2-4dd2-898d-f4dc258dcff6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:11.020727 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4575bd2f-bae2-4dd2-898d-f4dc258dcff6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:11.028062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4575bd2f-bae2-4dd2-898d-f4dc258dcff6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:11.028197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4575bd2f-bae2-4dd2-898d-f4dc258dcff6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:11.029008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4575bd2f-bae2-4dd2-898d-f4dc258dcff6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:11.029466 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4575bd2f-bae2-4dd2-898d-f4dc258dcff6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:11.090939 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4575bd2f-bae2-4dd2-898d-f4dc258dcff6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:11.098556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4575bd2f-bae2-4dd2-898d-f4dc258dcff6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082259 Jun 20 06:46:11.099121 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1195/2323] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:11 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:11.914804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0b5ec946-77a7-48a9-8293-6683a1c37930 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:11.915414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0b5ec946-77a7-48a9-8293-6683a1c37930 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 4cb55995-a9da-4681-b95f-11657fea5562] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:11.922591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b5ec946-77a7-48a9-8293-6683a1c37930 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:11.923035 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b5ec946-77a7-48a9-8293-6683a1c37930 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:11.923787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b5ec946-77a7-48a9-8293-6683a1c37930 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:11.924216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b5ec946-77a7-48a9-8293-6683a1c37930 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:11.988745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0b5ec946-77a7-48a9-8293-6683a1c37930 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:11.997341 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0b5ec946-77a7-48a9-8293-6683a1c37930 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562" status: 200 len: 1349 microversion: 2.1 time: 0.086267 Jun 20 06:46:11.997993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1129/2324] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:11 2022] GET /compute/v2.1/servers/4cb55995-a9da-4681-b95f-11657fea5562 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:12.116097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df7269f6-fbae-4ddb-9bf1-84131bb521fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:12.117744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-df7269f6-fbae-4ddb-9bf1-84131bb521fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:12.129778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df7269f6-fbae-4ddb-9bf1-84131bb521fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:12.130254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df7269f6-fbae-4ddb-9bf1-84131bb521fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:12.131032 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df7269f6-fbae-4ddb-9bf1-84131bb521fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:12.131476 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-df7269f6-fbae-4ddb-9bf1-84131bb521fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:12.193798 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-df7269f6-fbae-4ddb-9bf1-84131bb521fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:12.201847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-df7269f6-fbae-4ddb-9bf1-84131bb521fe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.090337 Jun 20 06:46:12.202405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1196/2325] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:12 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:13.219358 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-828498ac-f7c4-4cf6-824f-339bd198c9ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:13.219973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-828498ac-f7c4-4cf6-824f-339bd198c9ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:13.226398 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-828498ac-f7c4-4cf6-824f-339bd198c9ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:13.226842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-828498ac-f7c4-4cf6-824f-339bd198c9ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:13.227591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-828498ac-f7c4-4cf6-824f-339bd198c9ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:13.228027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-828498ac-f7c4-4cf6-824f-339bd198c9ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:13.291014 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-828498ac-f7c4-4cf6-824f-339bd198c9ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:13.300234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-828498ac-f7c4-4cf6-824f-339bd198c9ce tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085336 Jun 20 06:46:13.300799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1130/2326] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:13 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:14.317235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-08313884-8f00-4d03-ba46-fdce7dd0efc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:14.317876 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-08313884-8f00-4d03-ba46-fdce7dd0efc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:14.324461 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08313884-8f00-4d03-ba46-fdce7dd0efc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:14.324909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08313884-8f00-4d03-ba46-fdce7dd0efc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:14.325691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08313884-8f00-4d03-ba46-fdce7dd0efc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:14.326126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08313884-8f00-4d03-ba46-fdce7dd0efc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:14.387348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-08313884-8f00-4d03-ba46-fdce7dd0efc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:14.394985 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-08313884-8f00-4d03-ba46-fdce7dd0efc4 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081598 Jun 20 06:46:14.395569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1197/2327] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:14 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:15.411958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-224e4938-0cd2-41b1-a90b-d77b5a2595a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:15.412577 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-224e4938-0cd2-41b1-a90b-d77b5a2595a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:15.419552 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224e4938-0cd2-41b1-a90b-d77b5a2595a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:15.420005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224e4938-0cd2-41b1-a90b-d77b5a2595a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:15.420768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224e4938-0cd2-41b1-a90b-d77b5a2595a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:15.421213 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224e4938-0cd2-41b1-a90b-d77b5a2595a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:15.483248 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-224e4938-0cd2-41b1-a90b-d77b5a2595a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:15.491381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-224e4938-0cd2-41b1-a90b-d77b5a2595a3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083308 Jun 20 06:46:15.491951 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1131/2328] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:15 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:16.508342 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57e92a63-ea83-409f-840e-5d5e78781649 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:16.508944 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-57e92a63-ea83-409f-840e-5d5e78781649 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:16.515860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57e92a63-ea83-409f-840e-5d5e78781649 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:16.516307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57e92a63-ea83-409f-840e-5d5e78781649 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:16.517052 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57e92a63-ea83-409f-840e-5d5e78781649 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:16.517508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57e92a63-ea83-409f-840e-5d5e78781649 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:16.578344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-57e92a63-ea83-409f-840e-5d5e78781649 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:16.585729 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-57e92a63-ea83-409f-840e-5d5e78781649 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081106 Jun 20 06:46:16.586223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1198/2329] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:16 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:17.602060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6a4b0c27-57da-405a-b44d-70e00e54af52 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:17.602605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6a4b0c27-57da-405a-b44d-70e00e54af52 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:17.609327 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a4b0c27-57da-405a-b44d-70e00e54af52 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:17.609803 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a4b0c27-57da-405a-b44d-70e00e54af52 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:17.610560 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a4b0c27-57da-405a-b44d-70e00e54af52 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:17.610992 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a4b0c27-57da-405a-b44d-70e00e54af52 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:17.672613 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a4b0c27-57da-405a-b44d-70e00e54af52 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:17.680066 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6a4b0c27-57da-405a-b44d-70e00e54af52 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081834 Jun 20 06:46:17.680621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1132/2330] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:17 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:18.697715 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-857c9057-f6dc-4da9-96b9-f2955c3eb457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:18.698332 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-857c9057-f6dc-4da9-96b9-f2955c3eb457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:18.705522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-857c9057-f6dc-4da9-96b9-f2955c3eb457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:18.705965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-857c9057-f6dc-4da9-96b9-f2955c3eb457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:18.706713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-857c9057-f6dc-4da9-96b9-f2955c3eb457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:18.707142 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-857c9057-f6dc-4da9-96b9-f2955c3eb457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:18.769513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-857c9057-f6dc-4da9-96b9-f2955c3eb457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:18.776810 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-857c9057-f6dc-4da9-96b9-f2955c3eb457 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082898 Jun 20 06:46:18.778064 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1199/2331] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:18 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:19.794853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6a7b8107-b65e-41a7-998e-949de1da347e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:19.795466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6a7b8107-b65e-41a7-998e-949de1da347e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:19.797891 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=52 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:19.803202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a7b8107-b65e-41a7-998e-949de1da347e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:19.804070 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a7b8107-b65e-41a7-998e-949de1da347e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:19.805088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a7b8107-b65e-41a7-998e-949de1da347e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:19.805649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a7b8107-b65e-41a7-998e-949de1da347e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:19.869488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a7b8107-b65e-41a7-998e-949de1da347e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:19.877607 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6a7b8107-b65e-41a7-998e-949de1da347e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.087023 Jun 20 06:46:19.878173 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1133/2332] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:19 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:46:20.116772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:46:20.117307 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:46:20.895765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-720cf9ca-5126-49ff-ab2b-261318633924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:20.896371 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-720cf9ca-5126-49ff-ab2b-261318633924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:20.898711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=50 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:20.904895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-720cf9ca-5126-49ff-ab2b-261318633924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:20.905341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-720cf9ca-5126-49ff-ab2b-261318633924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:20.906119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-720cf9ca-5126-49ff-ab2b-261318633924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:20.906552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-720cf9ca-5126-49ff-ab2b-261318633924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:20.966200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-720cf9ca-5126-49ff-ab2b-261318633924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:20.973896 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-720cf9ca-5126-49ff-ab2b-261318633924 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081991 Jun 20 06:46:20.974449 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1200/2333] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:20 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:21.990585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e9535f49-c750-46f8-9154-be5d3e3ca54b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:21.991177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9535f49-c750-46f8-9154-be5d3e3ca54b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:21.997664 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9535f49-c750-46f8-9154-be5d3e3ca54b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:21.998105 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9535f49-c750-46f8-9154-be5d3e3ca54b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:21.998853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9535f49-c750-46f8-9154-be5d3e3ca54b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:21.999284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9535f49-c750-46f8-9154-be5d3e3ca54b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:22.060003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e9535f49-c750-46f8-9154-be5d3e3ca54b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:22.067278 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e9535f49-c750-46f8-9154-be5d3e3ca54b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080577 Jun 20 06:46:22.067835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1134/2334] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:21 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:23.084614 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cebc2e06-3fdc-411d-b2a6-900d9e5df616 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:23.085219 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cebc2e06-3fdc-411d-b2a6-900d9e5df616 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:23.091904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cebc2e06-3fdc-411d-b2a6-900d9e5df616 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:23.092348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cebc2e06-3fdc-411d-b2a6-900d9e5df616 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:23.093093 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cebc2e06-3fdc-411d-b2a6-900d9e5df616 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:23.093567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cebc2e06-3fdc-411d-b2a6-900d9e5df616 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:23.107982 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:23.154868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cebc2e06-3fdc-411d-b2a6-900d9e5df616 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:23.162240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cebc2e06-3fdc-411d-b2a6-900d9e5df616 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081417 Jun 20 06:46:23.162786 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1201/2335] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:23 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:24.179886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63a3ab7f-75d9-4933-9afa-9b548db425b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:24.180503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63a3ab7f-75d9-4933-9afa-9b548db425b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:24.187746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63a3ab7f-75d9-4933-9afa-9b548db425b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:24.188193 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63a3ab7f-75d9-4933-9afa-9b548db425b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:24.188945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63a3ab7f-75d9-4933-9afa-9b548db425b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:24.189395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63a3ab7f-75d9-4933-9afa-9b548db425b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:24.254576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-63a3ab7f-75d9-4933-9afa-9b548db425b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:24.263015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-63a3ab7f-75d9-4933-9afa-9b548db425b3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086916 Jun 20 06:46:24.263591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1135/2336] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:24 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:25.279405 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0fab1bf3-2308-4c93-a438-bc864747e6d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:25.280019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0fab1bf3-2308-4c93-a438-bc864747e6d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:25.286520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fab1bf3-2308-4c93-a438-bc864747e6d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:25.286904 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fab1bf3-2308-4c93-a438-bc864747e6d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:25.287661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fab1bf3-2308-4c93-a438-bc864747e6d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:25.288095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fab1bf3-2308-4c93-a438-bc864747e6d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:25.348728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0fab1bf3-2308-4c93-a438-bc864747e6d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:25.357011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0fab1bf3-2308-4c93-a438-bc864747e6d3 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082061 Jun 20 06:46:25.357598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1202/2337] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:25 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:26.374363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3ae7d597-07d3-4526-9544-8edfe873b1ae tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:26.374984 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3ae7d597-07d3-4526-9544-8edfe873b1ae tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:26.381683 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ae7d597-07d3-4526-9544-8edfe873b1ae tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:26.382172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ae7d597-07d3-4526-9544-8edfe873b1ae tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:26.382937 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ae7d597-07d3-4526-9544-8edfe873b1ae tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:26.383375 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ae7d597-07d3-4526-9544-8edfe873b1ae tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:26.445542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3ae7d597-07d3-4526-9544-8edfe873b1ae tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:26.452979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3ae7d597-07d3-4526-9544-8edfe873b1ae tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083076 Jun 20 06:46:26.453568 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1136/2338] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:26 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:46:27.470017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-13a31ae3-0ca0-48b8-9ddb-f9baf4634d3f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:27.470642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-13a31ae3-0ca0-48b8-9ddb-f9baf4634d3f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:27.477251 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13a31ae3-0ca0-48b8-9ddb-f9baf4634d3f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:27.477723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13a31ae3-0ca0-48b8-9ddb-f9baf4634d3f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:27.478469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13a31ae3-0ca0-48b8-9ddb-f9baf4634d3f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:27.478899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-13a31ae3-0ca0-48b8-9ddb-f9baf4634d3f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:27.539690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-13a31ae3-0ca0-48b8-9ddb-f9baf4634d3f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:27.548366 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-13a31ae3-0ca0-48b8-9ddb-f9baf4634d3f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082133 Jun 20 06:46:27.548920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1203/2339] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:27 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:28.565434 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7b9e58e3-9c21-4cad-9b32-c0d0a80ca07e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:28.566051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7b9e58e3-9c21-4cad-9b32-c0d0a80ca07e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:28.572594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b9e58e3-9c21-4cad-9b32-c0d0a80ca07e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:28.573045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b9e58e3-9c21-4cad-9b32-c0d0a80ca07e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:28.574865 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b9e58e3-9c21-4cad-9b32-c0d0a80ca07e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:28.575308 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b9e58e3-9c21-4cad-9b32-c0d0a80ca07e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:28.639062 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7b9e58e3-9c21-4cad-9b32-c0d0a80ca07e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:28.646566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7b9e58e3-9c21-4cad-9b32-c0d0a80ca07e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085039 Jun 20 06:46:28.647124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1137/2340] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:28 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:29.663960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1c15b1f3-fce5-4601-94c7-ef78b90720a1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:29.664569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1c15b1f3-fce5-4601-94c7-ef78b90720a1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:29.671151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c15b1f3-fce5-4601-94c7-ef78b90720a1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:29.671593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c15b1f3-fce5-4601-94c7-ef78b90720a1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:29.672343 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c15b1f3-fce5-4601-94c7-ef78b90720a1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:29.672773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c15b1f3-fce5-4601-94c7-ef78b90720a1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:29.733630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c15b1f3-fce5-4601-94c7-ef78b90720a1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:29.741127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1c15b1f3-fce5-4601-94c7-ef78b90720a1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081102 Jun 20 06:46:29.741723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1204/2341] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:29 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:30.758702 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-31183bb4-7f71-44e3-8ac0-cd6ccea50a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:30.759317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-31183bb4-7f71-44e3-8ac0-cd6ccea50a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:30.766598 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31183bb4-7f71-44e3-8ac0-cd6ccea50a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:30.767049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31183bb4-7f71-44e3-8ac0-cd6ccea50a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:30.767801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31183bb4-7f71-44e3-8ac0-cd6ccea50a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:30.768239 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31183bb4-7f71-44e3-8ac0-cd6ccea50a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:30.828689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-31183bb4-7f71-44e3-8ac0-cd6ccea50a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:30.836380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-31183bb4-7f71-44e3-8ac0-cd6ccea50a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081477 Jun 20 06:46:30.836949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1138/2342] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:30 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:31.853898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-24e2e54b-deab-464d-98c7-589e028c48d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:31.854503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-24e2e54b-deab-464d-98c7-589e028c48d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:31.861799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-24e2e54b-deab-464d-98c7-589e028c48d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:31.862245 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-24e2e54b-deab-464d-98c7-589e028c48d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:31.862994 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-24e2e54b-deab-464d-98c7-589e028c48d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:31.863421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-24e2e54b-deab-464d-98c7-589e028c48d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:31.927178 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-24e2e54b-deab-464d-98c7-589e028c48d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:31.935863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-24e2e54b-deab-464d-98c7-589e028c48d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085810 Jun 20 06:46:31.936428 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1205/2343] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:31 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:32.954168 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5b3465f9-72b9-4b2f-a258-e328c017da07 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:32.955272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5b3465f9-72b9-4b2f-a258-e328c017da07 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:32.962376 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b3465f9-72b9-4b2f-a258-e328c017da07 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:32.962825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b3465f9-72b9-4b2f-a258-e328c017da07 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:32.963596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b3465f9-72b9-4b2f-a258-e328c017da07 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:32.964232 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b3465f9-72b9-4b2f-a258-e328c017da07 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:33.028299 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5b3465f9-72b9-4b2f-a258-e328c017da07 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:33.035762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5b3465f9-72b9-4b2f-a258-e328c017da07 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086928 Jun 20 06:46:33.036325 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1139/2344] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:32 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:34.053607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a2b3aef-e16c-440e-9ff8-1f2ccd0deb72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:34.054224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2a2b3aef-e16c-440e-9ff8-1f2ccd0deb72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:34.061483 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a2b3aef-e16c-440e-9ff8-1f2ccd0deb72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:34.061930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a2b3aef-e16c-440e-9ff8-1f2ccd0deb72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:34.062689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a2b3aef-e16c-440e-9ff8-1f2ccd0deb72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:34.063116 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a2b3aef-e16c-440e-9ff8-1f2ccd0deb72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:34.122813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2a2b3aef-e16c-440e-9ff8-1f2ccd0deb72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:34.130328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2a2b3aef-e16c-440e-9ff8-1f2ccd0deb72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080660 Jun 20 06:46:34.130878 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1206/2345] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:34 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:35.148122 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-94cfacef-7994-49d3-a465-d90bc0b2e813 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:35.148662 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-94cfacef-7994-49d3-a465-d90bc0b2e813 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:35.155237 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94cfacef-7994-49d3-a465-d90bc0b2e813 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:35.155688 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94cfacef-7994-49d3-a465-d90bc0b2e813 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:35.156449 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94cfacef-7994-49d3-a465-d90bc0b2e813 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:35.156890 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94cfacef-7994-49d3-a465-d90bc0b2e813 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:35.216988 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94cfacef-7994-49d3-a465-d90bc0b2e813 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:35.224459 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-94cfacef-7994-49d3-a465-d90bc0b2e813 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080242 Jun 20 06:46:35.225031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1140/2346] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:35 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:36.242705 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ca90c44c-988f-4fa4-89a7-2a1177247c69 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:36.243314 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ca90c44c-988f-4fa4-89a7-2a1177247c69 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:36.250337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca90c44c-988f-4fa4-89a7-2a1177247c69 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:36.250782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca90c44c-988f-4fa4-89a7-2a1177247c69 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:36.251525 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca90c44c-988f-4fa4-89a7-2a1177247c69 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:36.251956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ca90c44c-988f-4fa4-89a7-2a1177247c69 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:36.317446 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ca90c44c-988f-4fa4-89a7-2a1177247c69 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:36.325284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ca90c44c-988f-4fa4-89a7-2a1177247c69 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086368 Jun 20 06:46:36.325898 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1207/2347] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:36 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:37.342101 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bf7cb944-a363-4c07-b1b7-2eef3632f69e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:37.342711 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bf7cb944-a363-4c07-b1b7-2eef3632f69e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:37.349144 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf7cb944-a363-4c07-b1b7-2eef3632f69e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:37.349627 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf7cb944-a363-4c07-b1b7-2eef3632f69e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:37.350377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf7cb944-a363-4c07-b1b7-2eef3632f69e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:37.350812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf7cb944-a363-4c07-b1b7-2eef3632f69e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:37.415141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bf7cb944-a363-4c07-b1b7-2eef3632f69e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:37.423414 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bf7cb944-a363-4c07-b1b7-2eef3632f69e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085199 Jun 20 06:46:37.423970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1141/2348] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:37 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:38.439608 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c5e4527-7fdb-4577-88c4-142e5bdb1b8a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:38.440203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c5e4527-7fdb-4577-88c4-142e5bdb1b8a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:38.446650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c5e4527-7fdb-4577-88c4-142e5bdb1b8a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:38.447094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c5e4527-7fdb-4577-88c4-142e5bdb1b8a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:38.447840 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c5e4527-7fdb-4577-88c4-142e5bdb1b8a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:38.448771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c5e4527-7fdb-4577-88c4-142e5bdb1b8a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:38.508605 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c5e4527-7fdb-4577-88c4-142e5bdb1b8a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:38.516956 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c5e4527-7fdb-4577-88c4-142e5bdb1b8a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081188 Jun 20 06:46:38.517539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1208/2349] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:38 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:39.533789 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-76d6550d-f9f3-46f8-8874-2e820c235112 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:39.534390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-76d6550d-f9f3-46f8-8874-2e820c235112 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:39.540808 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76d6550d-f9f3-46f8-8874-2e820c235112 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:39.541251 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76d6550d-f9f3-46f8-8874-2e820c235112 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:39.542635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76d6550d-f9f3-46f8-8874-2e820c235112 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:39.543067 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76d6550d-f9f3-46f8-8874-2e820c235112 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:39.605677 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76d6550d-f9f3-46f8-8874-2e820c235112 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:39.613130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-76d6550d-f9f3-46f8-8874-2e820c235112 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083210 Jun 20 06:46:39.613721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1142/2350] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:39 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:40.543329 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:46:40.544114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:46:40.630334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7a5891a0-b5c4-42d6-baa9-d8c6452ec6d5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:40.630942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7a5891a0-b5c4-42d6-baa9-d8c6452ec6d5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:40.638232 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a5891a0-b5c4-42d6-baa9-d8c6452ec6d5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:40.638676 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a5891a0-b5c4-42d6-baa9-d8c6452ec6d5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:40.639427 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a5891a0-b5c4-42d6-baa9-d8c6452ec6d5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:40.639859 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a5891a0-b5c4-42d6-baa9-d8c6452ec6d5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:40.700099 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7a5891a0-b5c4-42d6-baa9-d8c6452ec6d5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:40.707644 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7a5891a0-b5c4-42d6-baa9-d8c6452ec6d5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081135 Jun 20 06:46:40.708202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1209/2351] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:40 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:41.724474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dd17b5d8-e550-4187-991a-f4d069583e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:41.725069 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dd17b5d8-e550-4187-991a-f4d069583e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:41.731873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dd17b5d8-e550-4187-991a-f4d069583e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:41.732321 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dd17b5d8-e550-4187-991a-f4d069583e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:41.733077 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dd17b5d8-e550-4187-991a-f4d069583e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:41.733538 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dd17b5d8-e550-4187-991a-f4d069583e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:41.736022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=96 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:41.798698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dd17b5d8-e550-4187-991a-f4d069583e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:41.806196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dd17b5d8-e550-4187-991a-f4d069583e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085639 Jun 20 06:46:41.806752 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1143/2352] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:41 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:42.824828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dae8e48a-3ac1-4c76-8efc-9dc6033e4afd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:42.825568 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dae8e48a-3ac1-4c76-8efc-9dc6033e4afd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:42.831958 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dae8e48a-3ac1-4c76-8efc-9dc6033e4afd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:42.832400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dae8e48a-3ac1-4c76-8efc-9dc6033e4afd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:42.833151 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dae8e48a-3ac1-4c76-8efc-9dc6033e4afd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:42.833613 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dae8e48a-3ac1-4c76-8efc-9dc6033e4afd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:42.894081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dae8e48a-3ac1-4c76-8efc-9dc6033e4afd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:42.902118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dae8e48a-3ac1-4c76-8efc-9dc6033e4afd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081248 Jun 20 06:46:42.902682 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1210/2353] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:42 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:43.919027 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-534a4b98-2fc5-4bd4-b196-187d51e3cf29 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:43.919635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-534a4b98-2fc5-4bd4-b196-187d51e3cf29 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:43.926129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-534a4b98-2fc5-4bd4-b196-187d51e3cf29 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:43.926581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-534a4b98-2fc5-4bd4-b196-187d51e3cf29 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:43.927337 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-534a4b98-2fc5-4bd4-b196-187d51e3cf29 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:43.927774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-534a4b98-2fc5-4bd4-b196-187d51e3cf29 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:43.987585 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-534a4b98-2fc5-4bd4-b196-187d51e3cf29 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:43.995390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-534a4b98-2fc5-4bd4-b196-187d51e3cf29 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080393 Jun 20 06:46:43.995753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1144/2354] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:43 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:46:45.012353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f296f782-b1fa-4ab6-afeb-babab9d1d90b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:45.012942 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f296f782-b1fa-4ab6-afeb-babab9d1d90b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:45.019460 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f296f782-b1fa-4ab6-afeb-babab9d1d90b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:45.019899 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f296f782-b1fa-4ab6-afeb-babab9d1d90b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:45.020647 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f296f782-b1fa-4ab6-afeb-babab9d1d90b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:45.021075 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f296f782-b1fa-4ab6-afeb-babab9d1d90b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:45.081848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f296f782-b1fa-4ab6-afeb-babab9d1d90b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:45.089989 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f296f782-b1fa-4ab6-afeb-babab9d1d90b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082271 Jun 20 06:46:45.090544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1211/2355] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:45 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:46.107345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4f383557-9b89-4541-8f7f-23f7681bc556 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:46.107964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4f383557-9b89-4541-8f7f-23f7681bc556 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:46.114048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f383557-9b89-4541-8f7f-23f7681bc556 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:46.114506 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f383557-9b89-4541-8f7f-23f7681bc556 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:46.115266 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f383557-9b89-4541-8f7f-23f7681bc556 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:46.115706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4f383557-9b89-4541-8f7f-23f7681bc556 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:46.177824 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4f383557-9b89-4541-8f7f-23f7681bc556 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:46.185946 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4f383557-9b89-4541-8f7f-23f7681bc556 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082951 Jun 20 06:46:46.186509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1145/2356] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:46 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:47.203250 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d9cc399b-0b1d-420b-9225-329ee73e1381 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:47.203862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d9cc399b-0b1d-420b-9225-329ee73e1381 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:47.210310 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9cc399b-0b1d-420b-9225-329ee73e1381 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:47.210772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9cc399b-0b1d-420b-9225-329ee73e1381 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:47.211526 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9cc399b-0b1d-420b-9225-329ee73e1381 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:47.211960 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9cc399b-0b1d-420b-9225-329ee73e1381 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:47.274782 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d9cc399b-0b1d-420b-9225-329ee73e1381 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:47.282192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d9cc399b-0b1d-420b-9225-329ee73e1381 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082807 Jun 20 06:46:47.282763 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1212/2357] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:47 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:48.299288 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-495d10ca-f29c-4eb4-a05e-0979404a42ac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:48.299806 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-495d10ca-f29c-4eb4-a05e-0979404a42ac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:48.306290 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-495d10ca-f29c-4eb4-a05e-0979404a42ac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:48.306739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-495d10ca-f29c-4eb4-a05e-0979404a42ac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:48.308189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-495d10ca-f29c-4eb4-a05e-0979404a42ac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:48.308631 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-495d10ca-f29c-4eb4-a05e-0979404a42ac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:48.368901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-495d10ca-f29c-4eb4-a05e-0979404a42ac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:48.377096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-495d10ca-f29c-4eb4-a05e-0979404a42ac tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081964 Jun 20 06:46:48.377697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1146/2358] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:48 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:49.395167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ba2e7739-7d3e-47cd-9185-0a9f066b4f82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:49.395775 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ba2e7739-7d3e-47cd-9185-0a9f066b4f82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:49.403256 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba2e7739-7d3e-47cd-9185-0a9f066b4f82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:49.403714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba2e7739-7d3e-47cd-9185-0a9f066b4f82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:49.404482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba2e7739-7d3e-47cd-9185-0a9f066b4f82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:49.404919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba2e7739-7d3e-47cd-9185-0a9f066b4f82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:49.465632 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ba2e7739-7d3e-47cd-9185-0a9f066b4f82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:49.472992 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ba2e7739-7d3e-47cd-9185-0a9f066b4f82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081696 Jun 20 06:46:49.473575 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1213/2359] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:49 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:50.489904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c7452799-0392-4f25-bc42-4a3e7a2d1e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:50.490512 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c7452799-0392-4f25-bc42-4a3e7a2d1e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:50.492781 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:50.498739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7452799-0392-4f25-bc42-4a3e7a2d1e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:50.499182 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7452799-0392-4f25-bc42-4a3e7a2d1e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:50.499929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7452799-0392-4f25-bc42-4a3e7a2d1e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:50.500359 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7452799-0392-4f25-bc42-4a3e7a2d1e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:50.563095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c7452799-0392-4f25-bc42-4a3e7a2d1e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:50.570444 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c7452799-0392-4f25-bc42-4a3e7a2d1e48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084382 Jun 20 06:46:50.571003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1147/2360] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:50 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:51.587440 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8e3bf47a-468e-4646-9afc-12f724915c1c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:51.588011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8e3bf47a-468e-4646-9afc-12f724915c1c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:51.590344 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:51.595589 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e3bf47a-468e-4646-9afc-12f724915c1c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:51.596063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e3bf47a-468e-4646-9afc-12f724915c1c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:51.596805 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e3bf47a-468e-4646-9afc-12f724915c1c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:51.597239 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e3bf47a-468e-4646-9afc-12f724915c1c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:51.657587 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8e3bf47a-468e-4646-9afc-12f724915c1c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:51.664970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8e3bf47a-468e-4646-9afc-12f724915c1c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081485 Jun 20 06:46:51.665547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1214/2361] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:51 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:52.683365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fd71433a-4431-43f5-8703-36a1980c9542 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:52.683990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fd71433a-4431-43f5-8703-36a1980c9542 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:52.690604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd71433a-4431-43f5-8703-36a1980c9542 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:52.691063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd71433a-4431-43f5-8703-36a1980c9542 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:52.691817 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd71433a-4431-43f5-8703-36a1980c9542 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:52.692252 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd71433a-4431-43f5-8703-36a1980c9542 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:52.753346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fd71433a-4431-43f5-8703-36a1980c9542 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:52.760954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fd71433a-4431-43f5-8703-36a1980c9542 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082603 Jun 20 06:46:52.761527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1148/2362] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:52 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:53.779200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1646773f-070b-4842-b1a8-9b0d0d39f8d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:53.779800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1646773f-070b-4842-b1a8-9b0d0d39f8d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:53.786345 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1646773f-070b-4842-b1a8-9b0d0d39f8d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:53.786794 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1646773f-070b-4842-b1a8-9b0d0d39f8d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:53.787552 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1646773f-070b-4842-b1a8-9b0d0d39f8d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:53.787988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1646773f-070b-4842-b1a8-9b0d0d39f8d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:53.792361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=82 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:46:53.847866 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1646773f-070b-4842-b1a8-9b0d0d39f8d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:53.856148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1646773f-070b-4842-b1a8-9b0d0d39f8d2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081362 Jun 20 06:46:53.856704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1215/2363] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:53 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:54.873212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a48e3acd-1cff-4937-944e-4afcda20eafa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:54.873850 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a48e3acd-1cff-4937-944e-4afcda20eafa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:54.880315 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a48e3acd-1cff-4937-944e-4afcda20eafa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:54.880763 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a48e3acd-1cff-4937-944e-4afcda20eafa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:54.881559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a48e3acd-1cff-4937-944e-4afcda20eafa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:54.881991 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a48e3acd-1cff-4937-944e-4afcda20eafa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:54.949712 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a48e3acd-1cff-4937-944e-4afcda20eafa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:54.957164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a48e3acd-1cff-4937-944e-4afcda20eafa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.088839 Jun 20 06:46:54.957771 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1149/2364] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:54 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:55.973421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-67ba2ca7-3c35-4774-b030-76de3165f23a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:55.974041 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-67ba2ca7-3c35-4774-b030-76de3165f23a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:55.980970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67ba2ca7-3c35-4774-b030-76de3165f23a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:55.981432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67ba2ca7-3c35-4774-b030-76de3165f23a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:55.982197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67ba2ca7-3c35-4774-b030-76de3165f23a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:55.982629 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67ba2ca7-3c35-4774-b030-76de3165f23a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:56.043029 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-67ba2ca7-3c35-4774-b030-76de3165f23a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:56.050411 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-67ba2ca7-3c35-4774-b030-76de3165f23a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080893 Jun 20 06:46:56.050968 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1216/2365] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:55 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:57.067769 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-670a56ec-52f8-4e44-a91e-74e5081ddbf6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:57.068380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-670a56ec-52f8-4e44-a91e-74e5081ddbf6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:57.075875 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-670a56ec-52f8-4e44-a91e-74e5081ddbf6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:57.076433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-670a56ec-52f8-4e44-a91e-74e5081ddbf6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:57.077351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-670a56ec-52f8-4e44-a91e-74e5081ddbf6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:57.077912 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-670a56ec-52f8-4e44-a91e-74e5081ddbf6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:57.140179 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-670a56ec-52f8-4e44-a91e-74e5081ddbf6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:57.147654 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-670a56ec-52f8-4e44-a91e-74e5081ddbf6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083773 Jun 20 06:46:57.148209 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1150/2366] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:57 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:58.165095 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0149f708-34ed-41a9-9bea-b7c1421f4fb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:58.165724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0149f708-34ed-41a9-9bea-b7c1421f4fb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:58.172778 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0149f708-34ed-41a9-9bea-b7c1421f4fb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:58.173223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0149f708-34ed-41a9-9bea-b7c1421f4fb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:58.174006 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0149f708-34ed-41a9-9bea-b7c1421f4fb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:58.174446 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0149f708-34ed-41a9-9bea-b7c1421f4fb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:58.234295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0149f708-34ed-41a9-9bea-b7c1421f4fb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:58.241667 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0149f708-34ed-41a9-9bea-b7c1421f4fb1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080406 Jun 20 06:46:58.242224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1217/2367] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:58 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:46:59.258659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cb7cd8ec-7069-4ece-b53e-149a596a84cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:46:59.259192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cb7cd8ec-7069-4ece-b53e-149a596a84cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:46:59.266513 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb7cd8ec-7069-4ece-b53e-149a596a84cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:59.266966 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb7cd8ec-7069-4ece-b53e-149a596a84cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:59.267733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb7cd8ec-7069-4ece-b53e-149a596a84cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:46:59.268175 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cb7cd8ec-7069-4ece-b53e-149a596a84cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:46:59.332902 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cb7cd8ec-7069-4ece-b53e-149a596a84cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:46:59.341088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cb7cd8ec-7069-4ece-b53e-149a596a84cc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086483 Jun 20 06:46:59.341693 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1151/2368] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:46:59 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:00.358132 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8affdc92-e72f-4aeb-822c-b13a8509a18a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:00.358738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8affdc92-e72f-4aeb-822c-b13a8509a18a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:00.365127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8affdc92-e72f-4aeb-822c-b13a8509a18a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:00.365620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8affdc92-e72f-4aeb-822c-b13a8509a18a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:00.366373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8affdc92-e72f-4aeb-822c-b13a8509a18a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:00.366808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8affdc92-e72f-4aeb-822c-b13a8509a18a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:00.427435 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8affdc92-e72f-4aeb-822c-b13a8509a18a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:00.435824 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8affdc92-e72f-4aeb-822c-b13a8509a18a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081687 Jun 20 06:47:00.436383 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1218/2369] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:00 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:01.453049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1953e51c-d438-4cd8-8b03-cb76d5ed31ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:01.454678 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1953e51c-d438-4cd8-8b03-cb76d5ed31ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:01.461592 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1953e51c-d438-4cd8-8b03-cb76d5ed31ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:01.462212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1953e51c-d438-4cd8-8b03-cb76d5ed31ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:01.462911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1953e51c-d438-4cd8-8b03-cb76d5ed31ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:01.465056 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1953e51c-d438-4cd8-8b03-cb76d5ed31ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:01.533176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1953e51c-d438-4cd8-8b03-cb76d5ed31ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:01.540823 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1953e51c-d438-4cd8-8b03-cb76d5ed31ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.091664 Jun 20 06:47:01.541460 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1152/2370] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:01 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:02.556954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5c63da2e-d082-4bb6-af36-bdf4132c0c21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:02.557843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5c63da2e-d082-4bb6-af36-bdf4132c0c21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:02.564412 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c63da2e-d082-4bb6-af36-bdf4132c0c21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:02.564953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c63da2e-d082-4bb6-af36-bdf4132c0c21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:02.565748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c63da2e-d082-4bb6-af36-bdf4132c0c21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:02.566187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c63da2e-d082-4bb6-af36-bdf4132c0c21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:02.636352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5c63da2e-d082-4bb6-af36-bdf4132c0c21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:02.644305 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5c63da2e-d082-4bb6-af36-bdf4132c0c21 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.091321 Jun 20 06:47:02.644867 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1219/2371] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:02 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:03.661120 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6741594e-2609-409b-8813-a22d58575264 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:03.661764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6741594e-2609-409b-8813-a22d58575264 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:03.668292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6741594e-2609-409b-8813-a22d58575264 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:03.668738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6741594e-2609-409b-8813-a22d58575264 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:03.669526 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6741594e-2609-409b-8813-a22d58575264 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:03.669958 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6741594e-2609-409b-8813-a22d58575264 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:03.736362 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6741594e-2609-409b-8813-a22d58575264 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:03.744023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6741594e-2609-409b-8813-a22d58575264 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086643 Jun 20 06:47:03.744818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1153/2372] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:03 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:04.760922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-20f807cb-c61c-46e7-9882-4d32acce5b84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:04.761556 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-20f807cb-c61c-46e7-9882-4d32acce5b84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:04.767957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-20f807cb-c61c-46e7-9882-4d32acce5b84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:04.768399 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-20f807cb-c61c-46e7-9882-4d32acce5b84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:04.769143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-20f807cb-c61c-46e7-9882-4d32acce5b84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:04.769609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-20f807cb-c61c-46e7-9882-4d32acce5b84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:04.831645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-20f807cb-c61c-46e7-9882-4d32acce5b84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:04.839846 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-20f807cb-c61c-46e7-9882-4d32acce5b84 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082815 Jun 20 06:47:04.840397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1220/2373] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:04 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:05.857124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-04768efe-8e27-409e-8e96-f0ba8dc80edd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:05.857825 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-04768efe-8e27-409e-8e96-f0ba8dc80edd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:05.864410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04768efe-8e27-409e-8e96-f0ba8dc80edd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:05.864860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04768efe-8e27-409e-8e96-f0ba8dc80edd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:05.865650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04768efe-8e27-409e-8e96-f0ba8dc80edd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:05.866088 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04768efe-8e27-409e-8e96-f0ba8dc80edd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:05.926696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-04768efe-8e27-409e-8e96-f0ba8dc80edd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:05.934309 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-04768efe-8e27-409e-8e96-f0ba8dc80edd tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081575 Jun 20 06:47:05.934866 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1154/2374] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:05 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:06.951100 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-592ad1a1-443d-410d-b637-28a43fcd8c53 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:06.951713 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-592ad1a1-443d-410d-b637-28a43fcd8c53 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:06.958208 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-592ad1a1-443d-410d-b637-28a43fcd8c53 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:06.958661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-592ad1a1-443d-410d-b637-28a43fcd8c53 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:06.959421 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-592ad1a1-443d-410d-b637-28a43fcd8c53 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:06.959857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-592ad1a1-443d-410d-b637-28a43fcd8c53 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:07.026995 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-592ad1a1-443d-410d-b637-28a43fcd8c53 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:07.034689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-592ad1a1-443d-410d-b637-28a43fcd8c53 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.087586 Jun 20 06:47:07.035249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1221/2375] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:06 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:08.051913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-85db6e57-b5fe-4cc4-be47-f6b436704f41 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:08.052533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-85db6e57-b5fe-4cc4-be47-f6b436704f41 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:08.059544 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-85db6e57-b5fe-4cc4-be47-f6b436704f41 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:08.059989 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-85db6e57-b5fe-4cc4-be47-f6b436704f41 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:08.060738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-85db6e57-b5fe-4cc4-be47-f6b436704f41 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:08.061169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-85db6e57-b5fe-4cc4-be47-f6b436704f41 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:08.128060 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-85db6e57-b5fe-4cc4-be47-f6b436704f41 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:08.136187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-85db6e57-b5fe-4cc4-be47-f6b436704f41 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.088093 Jun 20 06:47:08.136995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1155/2376] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:08 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:09.152976 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-acd9d82b-70c1-4b5d-9e0d-2a0f2ac0a23f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:09.153752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-acd9d82b-70c1-4b5d-9e0d-2a0f2ac0a23f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:09.160303 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-acd9d82b-70c1-4b5d-9e0d-2a0f2ac0a23f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:09.160752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-acd9d82b-70c1-4b5d-9e0d-2a0f2ac0a23f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:09.161544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-acd9d82b-70c1-4b5d-9e0d-2a0f2ac0a23f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:09.161979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-acd9d82b-70c1-4b5d-9e0d-2a0f2ac0a23f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:09.227037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-acd9d82b-70c1-4b5d-9e0d-2a0f2ac0a23f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:09.235359 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-acd9d82b-70c1-4b5d-9e0d-2a0f2ac0a23f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086161 Jun 20 06:47:09.235967 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1222/2377] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:09 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:10.253282 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75825f95-cfdd-4947-8427-af6637dfa3f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:10.253925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-75825f95-cfdd-4947-8427-af6637dfa3f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:10.261036 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75825f95-cfdd-4947-8427-af6637dfa3f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:10.261523 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75825f95-cfdd-4947-8427-af6637dfa3f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:10.262543 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75825f95-cfdd-4947-8427-af6637dfa3f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:10.262983 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75825f95-cfdd-4947-8427-af6637dfa3f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:10.514292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-75825f95-cfdd-4947-8427-af6637dfa3f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:10.521637 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-75825f95-cfdd-4947-8427-af6637dfa3f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.272174 Jun 20 06:47:10.522191 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1156/2378] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:10 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:11.672193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f8afac46-9cd1-413e-8a27-6c6b62c9af06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:11.672799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f8afac46-9cd1-413e-8a27-6c6b62c9af06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:11.678709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8afac46-9cd1-413e-8a27-6c6b62c9af06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:11.679148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8afac46-9cd1-413e-8a27-6c6b62c9af06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:11.679892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8afac46-9cd1-413e-8a27-6c6b62c9af06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:11.680320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8afac46-9cd1-413e-8a27-6c6b62c9af06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:11.789350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f8afac46-9cd1-413e-8a27-6c6b62c9af06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:11.796920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f8afac46-9cd1-413e-8a27-6c6b62c9af06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.262066 Jun 20 06:47:11.797514 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1223/2379] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:11 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:12.813818 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-572f2c80-7cfd-49cf-846a-59d581d3c07f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:12.814371 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-572f2c80-7cfd-49cf-846a-59d581d3c07f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:12.820641 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-572f2c80-7cfd-49cf-846a-59d581d3c07f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:12.821087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-572f2c80-7cfd-49cf-846a-59d581d3c07f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:12.821860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-572f2c80-7cfd-49cf-846a-59d581d3c07f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:12.822954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-572f2c80-7cfd-49cf-846a-59d581d3c07f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:12.826745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:12.888392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-572f2c80-7cfd-49cf-846a-59d581d3c07f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:12.895967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-572f2c80-7cfd-49cf-846a-59d581d3c07f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086046 Jun 20 06:47:12.896530 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1157/2380] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:12 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:13.913504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ef7a2ced-64bc-49d9-b43b-2ea1ebad2a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:13.914137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ef7a2ced-64bc-49d9-b43b-2ea1ebad2a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:13.921149 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef7a2ced-64bc-49d9-b43b-2ea1ebad2a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:13.921626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef7a2ced-64bc-49d9-b43b-2ea1ebad2a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:13.922380 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef7a2ced-64bc-49d9-b43b-2ea1ebad2a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:13.922813 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ef7a2ced-64bc-49d9-b43b-2ea1ebad2a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:13.983594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ef7a2ced-64bc-49d9-b43b-2ea1ebad2a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:13.991091 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ef7a2ced-64bc-49d9-b43b-2ea1ebad2a57 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081517 Jun 20 06:47:13.991647 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1224/2381] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:13 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:15.008558 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3c943e62-cccd-4cbf-ae84-b9ddc62ec7fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:15.009160 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3c943e62-cccd-4cbf-ae84-b9ddc62ec7fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:15.015845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c943e62-cccd-4cbf-ae84-b9ddc62ec7fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:15.016294 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c943e62-cccd-4cbf-ae84-b9ddc62ec7fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:15.017047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c943e62-cccd-4cbf-ae84-b9ddc62ec7fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:15.017520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3c943e62-cccd-4cbf-ae84-b9ddc62ec7fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:15.076945 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3c943e62-cccd-4cbf-ae84-b9ddc62ec7fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:15.084582 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3c943e62-cccd-4cbf-ae84-b9ddc62ec7fb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.079865 Jun 20 06:47:15.085129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1158/2382] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:15 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:16.101670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e90c6712-5186-4c1a-88a4-eca917259cd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:16.102285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e90c6712-5186-4c1a-88a4-eca917259cd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:16.109372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e90c6712-5186-4c1a-88a4-eca917259cd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:16.109856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e90c6712-5186-4c1a-88a4-eca917259cd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:16.110618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e90c6712-5186-4c1a-88a4-eca917259cd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:16.111053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e90c6712-5186-4c1a-88a4-eca917259cd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:16.171197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e90c6712-5186-4c1a-88a4-eca917259cd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:16.178661 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e90c6712-5186-4c1a-88a4-eca917259cd7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080976 Jun 20 06:47:16.179224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1225/2383] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:16 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:17.194879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-82236f61-a9c9-496f-9a8b-5c8d86c42898 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:17.195489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-82236f61-a9c9-496f-9a8b-5c8d86c42898 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:17.201995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82236f61-a9c9-496f-9a8b-5c8d86c42898 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:17.202452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82236f61-a9c9-496f-9a8b-5c8d86c42898 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:17.203216 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82236f61-a9c9-496f-9a8b-5c8d86c42898 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:17.203655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-82236f61-a9c9-496f-9a8b-5c8d86c42898 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:17.266745 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-82236f61-a9c9-496f-9a8b-5c8d86c42898 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:17.274273 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-82236f61-a9c9-496f-9a8b-5c8d86c42898 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083239 Jun 20 06:47:17.274835 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1159/2384] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:17 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:18.291442 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a01cf2f3-6253-4b1c-92de-c3005b68fcbe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:18.292297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a01cf2f3-6253-4b1c-92de-c3005b68fcbe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:18.298892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a01cf2f3-6253-4b1c-92de-c3005b68fcbe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:18.299341 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a01cf2f3-6253-4b1c-92de-c3005b68fcbe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:18.300106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a01cf2f3-6253-4b1c-92de-c3005b68fcbe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:18.300541 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a01cf2f3-6253-4b1c-92de-c3005b68fcbe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:18.365152 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a01cf2f3-6253-4b1c-92de-c3005b68fcbe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:18.373287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a01cf2f3-6253-4b1c-92de-c3005b68fcbe tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085992 Jun 20 06:47:18.373892 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1226/2385] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:18 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:19.391178 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74182c03-24bb-4cce-a357-f63f7cb8e2ec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:19.391785 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74182c03-24bb-4cce-a357-f63f7cb8e2ec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:19.398176 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74182c03-24bb-4cce-a357-f63f7cb8e2ec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:19.398618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74182c03-24bb-4cce-a357-f63f7cb8e2ec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:19.399363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74182c03-24bb-4cce-a357-f63f7cb8e2ec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:19.399795 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74182c03-24bb-4cce-a357-f63f7cb8e2ec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:19.459879 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-74182c03-24bb-4cce-a357-f63f7cb8e2ec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:19.468032 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74182c03-24bb-4cce-a357-f63f7cb8e2ec tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080717 Jun 20 06:47:19.468591 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1160/2386] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:19 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:20.484019 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0407e8d9-5211-43c0-9656-70d7a6172783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:20.484626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0407e8d9-5211-43c0-9656-70d7a6172783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:20.491083 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0407e8d9-5211-43c0-9656-70d7a6172783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:20.491534 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0407e8d9-5211-43c0-9656-70d7a6172783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:20.492284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0407e8d9-5211-43c0-9656-70d7a6172783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:20.492719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0407e8d9-5211-43c0-9656-70d7a6172783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:20.553855 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0407e8d9-5211-43c0-9656-70d7a6172783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:20.561915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0407e8d9-5211-43c0-9656-70d7a6172783 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081719 Jun 20 06:47:20.562480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1227/2387] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:20 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:21.578894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-37907f6d-5edb-4131-a677-0cef105ae146 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:21.579510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-37907f6d-5edb-4131-a677-0cef105ae146 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:21.581904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:21.587787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37907f6d-5edb-4131-a677-0cef105ae146 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:21.588240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37907f6d-5edb-4131-a677-0cef105ae146 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:21.589005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37907f6d-5edb-4131-a677-0cef105ae146 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:21.589477 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37907f6d-5edb-4131-a677-0cef105ae146 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:21.652593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-37907f6d-5edb-4131-a677-0cef105ae146 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:21.660127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-37907f6d-5edb-4131-a677-0cef105ae146 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085103 Jun 20 06:47:21.660682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1161/2388] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:21 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:22.677176 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7e104278-140a-462b-8e0e-84af6b6ddc5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:22.677863 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7e104278-140a-462b-8e0e-84af6b6ddc5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:22.680395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:22.686563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e104278-140a-462b-8e0e-84af6b6ddc5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:22.687010 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e104278-140a-462b-8e0e-84af6b6ddc5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:22.687768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e104278-140a-462b-8e0e-84af6b6ddc5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:22.688201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e104278-140a-462b-8e0e-84af6b6ddc5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:22.750791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7e104278-140a-462b-8e0e-84af6b6ddc5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:22.758337 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7e104278-140a-462b-8e0e-84af6b6ddc5e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084993 Jun 20 06:47:22.758909 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1228/2389] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:22 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:23.774481 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fc77a6ad-3de0-4d3b-bf78-d57f82562659 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:23.775426 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fc77a6ad-3de0-4d3b-bf78-d57f82562659 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:23.781894 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc77a6ad-3de0-4d3b-bf78-d57f82562659 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:23.782357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc77a6ad-3de0-4d3b-bf78-d57f82562659 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:23.783123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc77a6ad-3de0-4d3b-bf78-d57f82562659 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:23.783567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc77a6ad-3de0-4d3b-bf78-d57f82562659 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:23.845655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fc77a6ad-3de0-4d3b-bf78-d57f82562659 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:23.853210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fc77a6ad-3de0-4d3b-bf78-d57f82562659 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082452 Jun 20 06:47:23.853814 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1162/2390] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:23 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:24.870008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5a41df69-94a5-48ac-a962-eb653bb17eee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:24.870597 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5a41df69-94a5-48ac-a962-eb653bb17eee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:24.877057 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a41df69-94a5-48ac-a962-eb653bb17eee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:24.877539 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a41df69-94a5-48ac-a962-eb653bb17eee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:24.878293 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a41df69-94a5-48ac-a962-eb653bb17eee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:24.878751 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a41df69-94a5-48ac-a962-eb653bb17eee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:24.882544 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:24.940509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a41df69-94a5-48ac-a962-eb653bb17eee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:24.948499 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5a41df69-94a5-48ac-a962-eb653bb17eee tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082340 Jun 20 06:47:24.949857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1229/2391] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:24 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:25.967238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ce91f5d3-e873-4910-b024-275f0a8e9786 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:25.967846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ce91f5d3-e873-4910-b024-275f0a8e9786 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:25.974652 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce91f5d3-e873-4910-b024-275f0a8e9786 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:25.975123 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce91f5d3-e873-4910-b024-275f0a8e9786 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:25.975905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce91f5d3-e873-4910-b024-275f0a8e9786 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:25.976334 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce91f5d3-e873-4910-b024-275f0a8e9786 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:26.039031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ce91f5d3-e873-4910-b024-275f0a8e9786 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:26.047275 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ce91f5d3-e873-4910-b024-275f0a8e9786 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084897 Jun 20 06:47:26.047837 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1163/2392] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:25 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:27.064737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dd96ca14-821a-480f-abc9-3758636051bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:27.065360 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dd96ca14-821a-480f-abc9-3758636051bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:27.072503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd96ca14-821a-480f-abc9-3758636051bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:27.072988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd96ca14-821a-480f-abc9-3758636051bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:27.073774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd96ca14-821a-480f-abc9-3758636051bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:27.074204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd96ca14-821a-480f-abc9-3758636051bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:27.133108 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dd96ca14-821a-480f-abc9-3758636051bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:27.141270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dd96ca14-821a-480f-abc9-3758636051bb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080405 Jun 20 06:47:27.141856 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1230/2393] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:27 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:28.159013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-011e9786-8c7b-4b88-b75e-03a8ba376e90 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:28.159649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-011e9786-8c7b-4b88-b75e-03a8ba376e90 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:28.167319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-011e9786-8c7b-4b88-b75e-03a8ba376e90 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:28.167768 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-011e9786-8c7b-4b88-b75e-03a8ba376e90 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:28.168525 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-011e9786-8c7b-4b88-b75e-03a8ba376e90 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:28.168962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-011e9786-8c7b-4b88-b75e-03a8ba376e90 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:28.230381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-011e9786-8c7b-4b88-b75e-03a8ba376e90 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:28.237843 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-011e9786-8c7b-4b88-b75e-03a8ba376e90 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082784 Jun 20 06:47:28.238408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1164/2394] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:28 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:29.256058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8077d20f-8fcb-4408-87b2-41c87803c83a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:29.257035 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8077d20f-8fcb-4408-87b2-41c87803c83a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:29.263752 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8077d20f-8fcb-4408-87b2-41c87803c83a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:29.264194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8077d20f-8fcb-4408-87b2-41c87803c83a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:29.264945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8077d20f-8fcb-4408-87b2-41c87803c83a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:29.265397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8077d20f-8fcb-4408-87b2-41c87803c83a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:29.325725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8077d20f-8fcb-4408-87b2-41c87803c83a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:29.333398 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8077d20f-8fcb-4408-87b2-41c87803c83a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081662 Jun 20 06:47:29.333957 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1231/2395] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:29 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:30.350234 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-11466c26-eb7c-4155-aa95-220c950d19a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:30.350853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-11466c26-eb7c-4155-aa95-220c950d19a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:30.358112 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11466c26-eb7c-4155-aa95-220c950d19a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:30.358570 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11466c26-eb7c-4155-aa95-220c950d19a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:30.359332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11466c26-eb7c-4155-aa95-220c950d19a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:30.359779 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11466c26-eb7c-4155-aa95-220c950d19a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:30.423128 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-11466c26-eb7c-4155-aa95-220c950d19a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:30.430705 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-11466c26-eb7c-4155-aa95-220c950d19a0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084366 Jun 20 06:47:30.431263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1165/2396] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:30 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:31.447711 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-27aff4f3-283d-4eda-a0cc-ae5187141877 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:31.448311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-27aff4f3-283d-4eda-a0cc-ae5187141877 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:31.455085 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27aff4f3-283d-4eda-a0cc-ae5187141877 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:31.455527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27aff4f3-283d-4eda-a0cc-ae5187141877 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:31.456274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27aff4f3-283d-4eda-a0cc-ae5187141877 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:31.456702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-27aff4f3-283d-4eda-a0cc-ae5187141877 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:31.516965 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-27aff4f3-283d-4eda-a0cc-ae5187141877 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:31.524306 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-27aff4f3-283d-4eda-a0cc-ae5187141877 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080391 Jun 20 06:47:31.524858 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1232/2397] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:31 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:32.541301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8322ebcd-4ec7-4a68-b0b5-c9b4e587f08f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:32.541997 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8322ebcd-4ec7-4a68-b0b5-c9b4e587f08f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:32.549268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8322ebcd-4ec7-4a68-b0b5-c9b4e587f08f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:32.549753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8322ebcd-4ec7-4a68-b0b5-c9b4e587f08f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:32.550529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8322ebcd-4ec7-4a68-b0b5-c9b4e587f08f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:32.550972 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8322ebcd-4ec7-4a68-b0b5-c9b4e587f08f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:32.617046 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8322ebcd-4ec7-4a68-b0b5-c9b4e587f08f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:32.625187 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8322ebcd-4ec7-4a68-b0b5-c9b4e587f08f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.087833 Jun 20 06:47:32.625784 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1166/2398] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:32 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:33.642390 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-aea6af40-038d-444a-ac56-74cd8d127a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:33.642997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-aea6af40-038d-444a-ac56-74cd8d127a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:33.648964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aea6af40-038d-444a-ac56-74cd8d127a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:33.649434 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aea6af40-038d-444a-ac56-74cd8d127a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:33.650181 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aea6af40-038d-444a-ac56-74cd8d127a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:33.650646 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-aea6af40-038d-444a-ac56-74cd8d127a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:33.710209 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-aea6af40-038d-444a-ac56-74cd8d127a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:33.717586 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-aea6af40-038d-444a-ac56-74cd8d127a61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.079177 Jun 20 06:47:33.718137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1233/2399] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:33 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:34.734433 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8c9e8ef0-f4b0-4baa-bc49-71d37fc67767 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:34.735033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8c9e8ef0-f4b0-4baa-bc49-71d37fc67767 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:34.741537 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c9e8ef0-f4b0-4baa-bc49-71d37fc67767 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:34.741983 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c9e8ef0-f4b0-4baa-bc49-71d37fc67767 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:34.742730 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c9e8ef0-f4b0-4baa-bc49-71d37fc67767 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:34.743194 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8c9e8ef0-f4b0-4baa-bc49-71d37fc67767 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:34.806065 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8c9e8ef0-f4b0-4baa-bc49-71d37fc67767 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:34.814104 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8c9e8ef0-f4b0-4baa-bc49-71d37fc67767 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083473 Jun 20 06:47:34.814666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1167/2400] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:34 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:35.831897 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-96d0f103-6a5b-42f3-9184-868e99e40c2b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:35.832504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-96d0f103-6a5b-42f3-9184-868e99e40c2b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:35.839273 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96d0f103-6a5b-42f3-9184-868e99e40c2b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:35.840720 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96d0f103-6a5b-42f3-9184-868e99e40c2b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:35.842397 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96d0f103-6a5b-42f3-9184-868e99e40c2b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:35.842853 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96d0f103-6a5b-42f3-9184-868e99e40c2b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:35.916413 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-96d0f103-6a5b-42f3-9184-868e99e40c2b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:35.925394 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-96d0f103-6a5b-42f3-9184-868e99e40c2b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.098219 Jun 20 06:47:35.925984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1234/2401] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:35 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:36.945787 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-18299e08-51d4-4fa7-bbfb-875dbb5703ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:36.946411 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-18299e08-51d4-4fa7-bbfb-875dbb5703ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:36.952876 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18299e08-51d4-4fa7-bbfb-875dbb5703ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:36.953319 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18299e08-51d4-4fa7-bbfb-875dbb5703ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:36.954096 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18299e08-51d4-4fa7-bbfb-875dbb5703ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:36.954533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-18299e08-51d4-4fa7-bbfb-875dbb5703ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:37.015073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-18299e08-51d4-4fa7-bbfb-875dbb5703ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:37.022550 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-18299e08-51d4-4fa7-bbfb-875dbb5703ab tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080559 Jun 20 06:47:37.023110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1168/2402] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:36 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:38.040000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0d2f5da7-1a4d-4f8b-88cf-735b1e0e6a48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:38.040670 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0d2f5da7-1a4d-4f8b-88cf-735b1e0e6a48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:38.047201 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d2f5da7-1a4d-4f8b-88cf-735b1e0e6a48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:38.047642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d2f5da7-1a4d-4f8b-88cf-735b1e0e6a48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:38.048392 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d2f5da7-1a4d-4f8b-88cf-735b1e0e6a48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:38.048828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d2f5da7-1a4d-4f8b-88cf-735b1e0e6a48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:38.109278 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d2f5da7-1a4d-4f8b-88cf-735b1e0e6a48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:38.116745 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0d2f5da7-1a4d-4f8b-88cf-735b1e0e6a48 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080640 Jun 20 06:47:38.117294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1235/2403] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:38 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:39.133909 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff883496-4364-4915-b9a6-5f7e230c945b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:39.134527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff883496-4364-4915-b9a6-5f7e230c945b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:39.141846 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff883496-4364-4915-b9a6-5f7e230c945b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:39.142291 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff883496-4364-4915-b9a6-5f7e230c945b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:39.143049 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff883496-4364-4915-b9a6-5f7e230c945b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:39.143480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff883496-4364-4915-b9a6-5f7e230c945b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:39.209357 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff883496-4364-4915-b9a6-5f7e230c945b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:39.217682 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff883496-4364-4915-b9a6-5f7e230c945b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.087643 Jun 20 06:47:39.218239 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1169/2404] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:39 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:40.234470 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-af33338f-d8eb-4a92-8c7a-26c8149cf247 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:40.235072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-af33338f-d8eb-4a92-8c7a-26c8149cf247 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:40.241607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af33338f-d8eb-4a92-8c7a-26c8149cf247 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:40.242040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af33338f-d8eb-4a92-8c7a-26c8149cf247 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:40.242795 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af33338f-d8eb-4a92-8c7a-26c8149cf247 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:40.243229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af33338f-d8eb-4a92-8c7a-26c8149cf247 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:40.304077 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-af33338f-d8eb-4a92-8c7a-26c8149cf247 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:40.312267 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-af33338f-d8eb-4a92-8c7a-26c8149cf247 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081647 Jun 20 06:47:40.312842 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1236/2405] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:40 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:41.329204 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-39849ae9-22da-4793-bc01-3c23aa9c0fd6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:41.329772 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-39849ae9-22da-4793-bc01-3c23aa9c0fd6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:41.336241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39849ae9-22da-4793-bc01-3c23aa9c0fd6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:41.336690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39849ae9-22da-4793-bc01-3c23aa9c0fd6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:41.337478 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39849ae9-22da-4793-bc01-3c23aa9c0fd6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:41.338612 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39849ae9-22da-4793-bc01-3c23aa9c0fd6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:41.398196 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-39849ae9-22da-4793-bc01-3c23aa9c0fd6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:41.406487 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-39849ae9-22da-4793-bc01-3c23aa9c0fd6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081229 Jun 20 06:47:41.407057 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1170/2406] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:41 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:42.423194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c325cad7-3bea-43a9-95ba-57fec388097f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:42.423804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c325cad7-3bea-43a9-95ba-57fec388097f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:42.430203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c325cad7-3bea-43a9-95ba-57fec388097f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:42.430649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c325cad7-3bea-43a9-95ba-57fec388097f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:42.431919 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c325cad7-3bea-43a9-95ba-57fec388097f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:42.432417 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c325cad7-3bea-43a9-95ba-57fec388097f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:42.493086 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c325cad7-3bea-43a9-95ba-57fec388097f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:42.501277 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c325cad7-3bea-43a9-95ba-57fec388097f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081895 Jun 20 06:47:42.501865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1237/2407] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:42 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:43.519004 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cc952eed-c659-43be-97ae-53585787146f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:43.519645 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cc952eed-c659-43be-97ae-53585787146f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:43.526131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc952eed-c659-43be-97ae-53585787146f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:43.526583 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc952eed-c659-43be-97ae-53585787146f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:43.527340 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc952eed-c659-43be-97ae-53585787146f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:43.527783 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cc952eed-c659-43be-97ae-53585787146f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:43.531604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:43.591520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cc952eed-c659-43be-97ae-53585787146f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:43.599015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cc952eed-c659-43be-97ae-53585787146f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083917 Jun 20 06:47:43.599572 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1171/2408] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:43 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:44.616828 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c68dc4b0-11a5-431d-b81a-a8909dd3a5d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:44.617352 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c68dc4b0-11a5-431d-b81a-a8909dd3a5d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:44.624725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c68dc4b0-11a5-431d-b81a-a8909dd3a5d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:44.625167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c68dc4b0-11a5-431d-b81a-a8909dd3a5d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:44.625949 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c68dc4b0-11a5-431d-b81a-a8909dd3a5d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:44.626375 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c68dc4b0-11a5-431d-b81a-a8909dd3a5d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:44.687308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c68dc4b0-11a5-431d-b81a-a8909dd3a5d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:44.695008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c68dc4b0-11a5-431d-b81a-a8909dd3a5d9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082228 Jun 20 06:47:44.695573 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1238/2409] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:44 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:45.712116 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cf2d7b76-8aac-4982-a33a-576e8841cacb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:45.713408 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cf2d7b76-8aac-4982-a33a-576e8841cacb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:45.719312 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf2d7b76-8aac-4982-a33a-576e8841cacb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:45.719788 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf2d7b76-8aac-4982-a33a-576e8841cacb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:45.720542 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf2d7b76-8aac-4982-a33a-576e8841cacb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:45.720976 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf2d7b76-8aac-4982-a33a-576e8841cacb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:45.781539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cf2d7b76-8aac-4982-a33a-576e8841cacb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:45.788929 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cf2d7b76-8aac-4982-a33a-576e8841cacb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080824 Jun 20 06:47:45.789505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1172/2410] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:45 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:46.806707 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ee5d018f-7a50-4f67-a6fd-672115a453f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:46.807338 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ee5d018f-7a50-4f67-a6fd-672115a453f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:46.814137 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee5d018f-7a50-4f67-a6fd-672115a453f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:46.814581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee5d018f-7a50-4f67-a6fd-672115a453f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:46.815329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee5d018f-7a50-4f67-a6fd-672115a453f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:46.815758 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ee5d018f-7a50-4f67-a6fd-672115a453f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:46.876607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ee5d018f-7a50-4f67-a6fd-672115a453f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:46.884069 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ee5d018f-7a50-4f67-a6fd-672115a453f0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081367 Jun 20 06:47:46.884664 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1239/2411] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:46 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:47.901718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-787e8013-2138-4b7f-ada1-5432c76037ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:47.902330 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-787e8013-2138-4b7f-ada1-5432c76037ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:47.908979 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-787e8013-2138-4b7f-ada1-5432c76037ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:47.909461 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-787e8013-2138-4b7f-ada1-5432c76037ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:47.910219 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-787e8013-2138-4b7f-ada1-5432c76037ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:47.910658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-787e8013-2138-4b7f-ada1-5432c76037ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:47.973953 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-787e8013-2138-4b7f-ada1-5432c76037ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:47.983388 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-787e8013-2138-4b7f-ada1-5432c76037ef tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086074 Jun 20 06:47:47.983993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1173/2412] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:47 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:49.000750 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1ca4ae3d-9521-43f3-8467-b098997e4a33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:49.001401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1ca4ae3d-9521-43f3-8467-b098997e4a33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:49.007774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ca4ae3d-9521-43f3-8467-b098997e4a33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:49.008215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ca4ae3d-9521-43f3-8467-b098997e4a33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:49.008974 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ca4ae3d-9521-43f3-8467-b098997e4a33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:49.009504 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ca4ae3d-9521-43f3-8467-b098997e4a33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:49.073450 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1ca4ae3d-9521-43f3-8467-b098997e4a33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:49.080932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1ca4ae3d-9521-43f3-8467-b098997e4a33 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084008 Jun 20 06:47:49.081804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1240/2413] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:48 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:50.098284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bc655f1-e25a-455e-9ffa-bf60822b5ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:50.098899 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7bc655f1-e25a-455e-9ffa-bf60822b5ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:50.106186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bc655f1-e25a-455e-9ffa-bf60822b5ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:50.106634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bc655f1-e25a-455e-9ffa-bf60822b5ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:50.107395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bc655f1-e25a-455e-9ffa-bf60822b5ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:50.107848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bc655f1-e25a-455e-9ffa-bf60822b5ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:50.137872 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Traceback (most recent call last): Jun 20 06:47:50.138022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 20 06:47:50.138022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: timer() Jun 20 06:47:50.138022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 20 06:47:50.138022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: cb(*args, **kw) Jun 20 06:47:50.138022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jun 20 06:47:50.138022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: waiter.switch() Jun 20 06:47:50.138022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: greenlet.error: cannot switch to a different thread Jun 20 06:47:50.198833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bc655f1-e25a-455e-9ffa-bf60822b5ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:50.206328 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bc655f1-e25a-455e-9ffa-bf60822b5ec1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.111861 Jun 20 06:47:50.206889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1174/2414] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:50 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:47:51.223129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3e56ca4a-85c7-4ce2-b697-f6c236a17e06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:51.223732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3e56ca4a-85c7-4ce2-b697-f6c236a17e06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:51.230819 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e56ca4a-85c7-4ce2-b697-f6c236a17e06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:51.231264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e56ca4a-85c7-4ce2-b697-f6c236a17e06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:51.232008 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e56ca4a-85c7-4ce2-b697-f6c236a17e06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:51.232438 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e56ca4a-85c7-4ce2-b697-f6c236a17e06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:51.292780 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3e56ca4a-85c7-4ce2-b697-f6c236a17e06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:51.300205 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3e56ca4a-85c7-4ce2-b697-f6c236a17e06 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080904 Jun 20 06:47:51.300762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1241/2415] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:51 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:52.316905 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b123a76c-1d9f-4cc7-85ae-98c71721fd46 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:52.317563 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b123a76c-1d9f-4cc7-85ae-98c71721fd46 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:52.319853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:52.326019 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b123a76c-1d9f-4cc7-85ae-98c71721fd46 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:52.326470 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b123a76c-1d9f-4cc7-85ae-98c71721fd46 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:52.327241 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b123a76c-1d9f-4cc7-85ae-98c71721fd46 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:52.327680 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b123a76c-1d9f-4cc7-85ae-98c71721fd46 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:52.390993 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b123a76c-1d9f-4cc7-85ae-98c71721fd46 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:52.398461 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b123a76c-1d9f-4cc7-85ae-98c71721fd46 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085459 Jun 20 06:47:52.399025 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1175/2416] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:52 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:53.415419 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6b955744-4b1a-4ab4-972a-96084af3907b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:53.416240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6b955744-4b1a-4ab4-972a-96084af3907b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:53.418520 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:53.423826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b955744-4b1a-4ab4-972a-96084af3907b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:53.424269 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b955744-4b1a-4ab4-972a-96084af3907b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:53.425018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b955744-4b1a-4ab4-972a-96084af3907b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:53.425474 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b955744-4b1a-4ab4-972a-96084af3907b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:53.485188 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6b955744-4b1a-4ab4-972a-96084af3907b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:53.493240 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6b955744-4b1a-4ab4-972a-96084af3907b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081753 Jun 20 06:47:53.494367 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1242/2417] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:53 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:54.510666 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-acca969c-2577-4816-b90b-5c267c7cd336 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:54.511279 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-acca969c-2577-4816-b90b-5c267c7cd336 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:54.518038 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-acca969c-2577-4816-b90b-5c267c7cd336 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:54.518493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-acca969c-2577-4816-b90b-5c267c7cd336 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:54.519256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-acca969c-2577-4816-b90b-5c267c7cd336 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:54.519697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-acca969c-2577-4816-b90b-5c267c7cd336 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:54.581740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-acca969c-2577-4816-b90b-5c267c7cd336 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:54.590021 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-acca969c-2577-4816-b90b-5c267c7cd336 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083186 Jun 20 06:47:54.591620 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1176/2418] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:54 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:55.607642 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6dd0449d-e052-43cb-9279-60af1f26c0cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:55.608192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6dd0449d-e052-43cb-9279-60af1f26c0cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:55.614849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6dd0449d-e052-43cb-9279-60af1f26c0cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:55.615295 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6dd0449d-e052-43cb-9279-60af1f26c0cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:55.616047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6dd0449d-e052-43cb-9279-60af1f26c0cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:55.616473 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6dd0449d-e052-43cb-9279-60af1f26c0cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:55.619668 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:47:55.677997 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6dd0449d-e052-43cb-9279-60af1f26c0cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:55.686128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6dd0449d-e052-43cb-9279-60af1f26c0cb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083115 Jun 20 06:47:55.686696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1243/2419] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:55 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:56.703017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-11fdc207-f522-4855-ae44-54ab636cdd50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:56.703610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-11fdc207-f522-4855-ae44-54ab636cdd50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:56.710109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11fdc207-f522-4855-ae44-54ab636cdd50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:56.710556 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11fdc207-f522-4855-ae44-54ab636cdd50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:56.711305 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11fdc207-f522-4855-ae44-54ab636cdd50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:56.711733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-11fdc207-f522-4855-ae44-54ab636cdd50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:56.775285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-11fdc207-f522-4855-ae44-54ab636cdd50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:56.782860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-11fdc207-f522-4855-ae44-54ab636cdd50 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083755 Jun 20 06:47:56.783419 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1177/2420] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:56 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:57.570127 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:47:57.570673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:47:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:47:57.800447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3b605f5f-4a7b-4b52-a566-ac0268c7ea2e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:57.801061 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3b605f5f-4a7b-4b52-a566-ac0268c7ea2e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:57.808533 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b605f5f-4a7b-4b52-a566-ac0268c7ea2e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:57.808988 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b605f5f-4a7b-4b52-a566-ac0268c7ea2e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:57.809781 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b605f5f-4a7b-4b52-a566-ac0268c7ea2e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:57.810221 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b605f5f-4a7b-4b52-a566-ac0268c7ea2e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:57.872924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3b605f5f-4a7b-4b52-a566-ac0268c7ea2e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:57.880482 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3b605f5f-4a7b-4b52-a566-ac0268c7ea2e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083883 Jun 20 06:47:57.881036 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1244/2421] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:57 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:58.897813 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-969a1332-f26b-4d6c-81d9-88b8dfb648bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:58.898430 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-969a1332-f26b-4d6c-81d9-88b8dfb648bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:58.905533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-969a1332-f26b-4d6c-81d9-88b8dfb648bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:58.905986 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-969a1332-f26b-4d6c-81d9-88b8dfb648bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:58.906744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-969a1332-f26b-4d6c-81d9-88b8dfb648bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:47:58.907185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-969a1332-f26b-4d6c-81d9-88b8dfb648bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:47:58.967110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-969a1332-f26b-4d6c-81d9-88b8dfb648bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:47:58.974614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-969a1332-f26b-4d6c-81d9-88b8dfb648bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080711 Jun 20 06:47:58.975181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1178/2422] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:58 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:47:59.807015 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:47:59.807355 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:47:59.992361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea6e3e47-c0f5-42f1-9dff-54dca9184fc8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:47:59.992962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ea6e3e47-c0f5-42f1-9dff-54dca9184fc8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:47:59.999871 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6e3e47-c0f5-42f1-9dff-54dca9184fc8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:00.000311 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6e3e47-c0f5-42f1-9dff-54dca9184fc8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:00.001056 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6e3e47-c0f5-42f1-9dff-54dca9184fc8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:00.001508 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6e3e47-c0f5-42f1-9dff-54dca9184fc8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:00.061193 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ea6e3e47-c0f5-42f1-9dff-54dca9184fc8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:00.068771 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ea6e3e47-c0f5-42f1-9dff-54dca9184fc8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080293 Jun 20 06:48:00.069329 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1245/2423] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:47:59 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:01.085520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5a94eb4b-ae09-4180-961f-b935f138ff7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:01.086169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5a94eb4b-ae09-4180-961f-b935f138ff7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:01.092799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a94eb4b-ae09-4180-961f-b935f138ff7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:01.093240 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a94eb4b-ae09-4180-961f-b935f138ff7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:01.094164 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a94eb4b-ae09-4180-961f-b935f138ff7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:01.094601 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a94eb4b-ae09-4180-961f-b935f138ff7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:01.162954 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5a94eb4b-ae09-4180-961f-b935f138ff7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:01.171363 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5a94eb4b-ae09-4180-961f-b935f138ff7c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.089701 Jun 20 06:48:01.171921 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1179/2424] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:01 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:02.188097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-69e74bb4-9757-421c-b8f4-d7a24a184036 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:02.188736 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-69e74bb4-9757-421c-b8f4-d7a24a184036 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:02.195198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-69e74bb4-9757-421c-b8f4-d7a24a184036 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:02.195647 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-69e74bb4-9757-421c-b8f4-d7a24a184036 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:02.196945 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-69e74bb4-9757-421c-b8f4-d7a24a184036 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:02.197400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-69e74bb4-9757-421c-b8f4-d7a24a184036 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:02.256297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-69e74bb4-9757-421c-b8f4-d7a24a184036 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:02.264467 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-69e74bb4-9757-421c-b8f4-d7a24a184036 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080275 Jun 20 06:48:02.265021 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1246/2425] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:02 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:03.282198 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d1adbcaa-32e4-4ed6-82f6-03e30d856b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:03.283033 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d1adbcaa-32e4-4ed6-82f6-03e30d856b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:03.289849 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1adbcaa-32e4-4ed6-82f6-03e30d856b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:03.290345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1adbcaa-32e4-4ed6-82f6-03e30d856b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:03.291274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1adbcaa-32e4-4ed6-82f6-03e30d856b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:03.291848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1adbcaa-32e4-4ed6-82f6-03e30d856b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:03.356604 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d1adbcaa-32e4-4ed6-82f6-03e30d856b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:03.364107 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d1adbcaa-32e4-4ed6-82f6-03e30d856b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086606 Jun 20 06:48:03.364670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1180/2426] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:03 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:04.382186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e57a1815-aea3-43b2-8312-d7c5c36f768b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:04.382791 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e57a1815-aea3-43b2-8312-d7c5c36f768b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:04.389678 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e57a1815-aea3-43b2-8312-d7c5c36f768b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:04.390119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e57a1815-aea3-43b2-8312-d7c5c36f768b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:04.390862 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e57a1815-aea3-43b2-8312-d7c5c36f768b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:04.391292 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e57a1815-aea3-43b2-8312-d7c5c36f768b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:04.453963 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e57a1815-aea3-43b2-8312-d7c5c36f768b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:04.461312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e57a1815-aea3-43b2-8312-d7c5c36f768b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082926 Jun 20 06:48:04.462500 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1247/2427] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:04 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:05.478750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e57d355e-4e86-462f-95b0-52f725be7239 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:05.479367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e57d355e-4e86-462f-95b0-52f725be7239 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:05.485868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e57d355e-4e86-462f-95b0-52f725be7239 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:05.486324 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e57d355e-4e86-462f-95b0-52f725be7239 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:05.487089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e57d355e-4e86-462f-95b0-52f725be7239 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:05.487531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e57d355e-4e86-462f-95b0-52f725be7239 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:05.550486 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e57d355e-4e86-462f-95b0-52f725be7239 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:05.558006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e57d355e-4e86-462f-95b0-52f725be7239 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083596 Jun 20 06:48:05.558567 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1181/2428] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:05 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:06.575429 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-14f6dd44-3440-4744-a94e-b9db8474c4d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:06.576033 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-14f6dd44-3440-4744-a94e-b9db8474c4d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:06.582503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-14f6dd44-3440-4744-a94e-b9db8474c4d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:06.582886 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-14f6dd44-3440-4744-a94e-b9db8474c4d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:06.583631 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-14f6dd44-3440-4744-a94e-b9db8474c4d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:06.584058 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-14f6dd44-3440-4744-a94e-b9db8474c4d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:06.644724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-14f6dd44-3440-4744-a94e-b9db8474c4d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:06.652192 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-14f6dd44-3440-4744-a94e-b9db8474c4d6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081172 Jun 20 06:48:06.652742 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1248/2429] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:06 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:48:07.668390 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1446a2a8-3f59-4aac-9f4b-1f11d457fa72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:07.668995 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1446a2a8-3f59-4aac-9f4b-1f11d457fa72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:07.675392 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1446a2a8-3f59-4aac-9f4b-1f11d457fa72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:07.675833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1446a2a8-3f59-4aac-9f4b-1f11d457fa72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:07.676580 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1446a2a8-3f59-4aac-9f4b-1f11d457fa72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:07.677010 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1446a2a8-3f59-4aac-9f4b-1f11d457fa72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:07.740679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1446a2a8-3f59-4aac-9f4b-1f11d457fa72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:07.748774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1446a2a8-3f59-4aac-9f4b-1f11d457fa72 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084362 Jun 20 06:48:07.749335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1182/2430] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:07 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:08.765350 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a2e6ae97-1e13-4ce9-afe7-4b30b07f2c01 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:08.766118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a2e6ae97-1e13-4ce9-afe7-4b30b07f2c01 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:08.772468 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2e6ae97-1e13-4ce9-afe7-4b30b07f2c01 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:08.772913 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2e6ae97-1e13-4ce9-afe7-4b30b07f2c01 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:08.773692 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2e6ae97-1e13-4ce9-afe7-4b30b07f2c01 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:08.774125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2e6ae97-1e13-4ce9-afe7-4b30b07f2c01 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:08.833826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a2e6ae97-1e13-4ce9-afe7-4b30b07f2c01 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:08.841196 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a2e6ae97-1e13-4ce9-afe7-4b30b07f2c01 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.079886 Jun 20 06:48:08.841785 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1249/2431] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:08 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:09.857833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fdd4d96c-e754-4a95-ad51-b1702def06f5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:09.858452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fdd4d96c-e754-4a95-ad51-b1702def06f5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:09.865108 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fdd4d96c-e754-4a95-ad51-b1702def06f5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:09.865597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fdd4d96c-e754-4a95-ad51-b1702def06f5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:09.866356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fdd4d96c-e754-4a95-ad51-b1702def06f5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:09.866794 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fdd4d96c-e754-4a95-ad51-b1702def06f5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:09.929099 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fdd4d96c-e754-4a95-ad51-b1702def06f5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:09.936586 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fdd4d96c-e754-4a95-ad51-b1702def06f5 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082594 Jun 20 06:48:09.937141 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1183/2432] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:09 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:10.953537 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-49b7b470-1324-432d-8dbe-ae32596a2ffb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:10.954134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-49b7b470-1324-432d-8dbe-ae32596a2ffb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:10.960594 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49b7b470-1324-432d-8dbe-ae32596a2ffb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:10.961044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49b7b470-1324-432d-8dbe-ae32596a2ffb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:10.962681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49b7b470-1324-432d-8dbe-ae32596a2ffb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:10.962837 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49b7b470-1324-432d-8dbe-ae32596a2ffb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:11.024799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-49b7b470-1324-432d-8dbe-ae32596a2ffb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:11.032328 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-49b7b470-1324-432d-8dbe-ae32596a2ffb tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082691 Jun 20 06:48:11.032894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1250/2433] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:10 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:12.049735 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b236003a-1599-413e-a84b-a3552c76ca43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:12.050349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b236003a-1599-413e-a84b-a3552c76ca43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:12.057501 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b236003a-1599-413e-a84b-a3552c76ca43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:12.057960 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b236003a-1599-413e-a84b-a3552c76ca43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:12.058726 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b236003a-1599-413e-a84b-a3552c76ca43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:12.059173 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b236003a-1599-413e-a84b-a3552c76ca43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:12.120959 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b236003a-1599-413e-a84b-a3552c76ca43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:12.128696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b236003a-1599-413e-a84b-a3552c76ca43 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082873 Jun 20 06:48:12.129326 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1184/2434] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:12 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:13.146040 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9ed85b32-6795-4848-b2ff-dc2b84d9144d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:13.146644 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9ed85b32-6795-4848-b2ff-dc2b84d9144d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:13.153703 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ed85b32-6795-4848-b2ff-dc2b84d9144d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:13.154148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ed85b32-6795-4848-b2ff-dc2b84d9144d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:13.154890 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ed85b32-6795-4848-b2ff-dc2b84d9144d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:13.155318 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ed85b32-6795-4848-b2ff-dc2b84d9144d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:13.217289 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9ed85b32-6795-4848-b2ff-dc2b84d9144d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:13.224694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9ed85b32-6795-4848-b2ff-dc2b84d9144d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082478 Jun 20 06:48:13.225243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1251/2435] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:13 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:14.242307 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c490bbe5-26bd-458f-9c41-71a5b5d5e62f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:14.243463 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c490bbe5-26bd-458f-9c41-71a5b5d5e62f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:14.249928 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c490bbe5-26bd-458f-9c41-71a5b5d5e62f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:14.250378 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c490bbe5-26bd-458f-9c41-71a5b5d5e62f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:14.251133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c490bbe5-26bd-458f-9c41-71a5b5d5e62f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:14.251569 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c490bbe5-26bd-458f-9c41-71a5b5d5e62f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:14.254076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:14.317271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c490bbe5-26bd-458f-9c41-71a5b5d5e62f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:14.325622 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c490bbe5-26bd-458f-9c41-71a5b5d5e62f tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.087217 Jun 20 06:48:14.326186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1185/2436] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:14 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:15.342479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-231b4ac8-8308-4fa3-a266-3f56f60df3e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:15.343110 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-231b4ac8-8308-4fa3-a266-3f56f60df3e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:15.349486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-231b4ac8-8308-4fa3-a266-3f56f60df3e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:15.349933 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-231b4ac8-8308-4fa3-a266-3f56f60df3e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:15.350679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-231b4ac8-8308-4fa3-a266-3f56f60df3e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:15.351107 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-231b4ac8-8308-4fa3-a266-3f56f60df3e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:15.411728 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-231b4ac8-8308-4fa3-a266-3f56f60df3e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:15.419068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-231b4ac8-8308-4fa3-a266-3f56f60df3e2 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080388 Jun 20 06:48:15.419618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1252/2437] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:15 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:16.437150 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7fb78c28-693b-4746-a11a-71ada3c2caa1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:16.437777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7fb78c28-693b-4746-a11a-71ada3c2caa1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:16.443738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fb78c28-693b-4746-a11a-71ada3c2caa1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:16.444185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fb78c28-693b-4746-a11a-71ada3c2caa1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:16.444931 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fb78c28-693b-4746-a11a-71ada3c2caa1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:16.445351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7fb78c28-693b-4746-a11a-71ada3c2caa1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:16.504399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7fb78c28-693b-4746-a11a-71ada3c2caa1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:16.512148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7fb78c28-693b-4746-a11a-71ada3c2caa1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.078966 Jun 20 06:48:16.512706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1186/2438] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:16 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:17.528915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c193b408-7ef4-4c1e-81a3-fb19922bf708 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:17.529542 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c193b408-7ef4-4c1e-81a3-fb19922bf708 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:17.535906 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c193b408-7ef4-4c1e-81a3-fb19922bf708 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:17.536348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c193b408-7ef4-4c1e-81a3-fb19922bf708 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:17.537096 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c193b408-7ef4-4c1e-81a3-fb19922bf708 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:17.537553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c193b408-7ef4-4c1e-81a3-fb19922bf708 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:17.596934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c193b408-7ef4-4c1e-81a3-fb19922bf708 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:17.604593 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c193b408-7ef4-4c1e-81a3-fb19922bf708 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.079512 Jun 20 06:48:17.605146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1253/2439] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:17 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:18.343674 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:48:18.343848 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:48:18.622374 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0d0aa8ad-3b1b-43ed-baa5-0046e9865e61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:18.622914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0d0aa8ad-3b1b-43ed-baa5-0046e9865e61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:18.629323 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d0aa8ad-3b1b-43ed-baa5-0046e9865e61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:18.629807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d0aa8ad-3b1b-43ed-baa5-0046e9865e61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:18.630573 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d0aa8ad-3b1b-43ed-baa5-0046e9865e61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:18.631018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d0aa8ad-3b1b-43ed-baa5-0046e9865e61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:18.694339 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0d0aa8ad-3b1b-43ed-baa5-0046e9865e61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:18.702000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0d0aa8ad-3b1b-43ed-baa5-0046e9865e61 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084184 Jun 20 06:48:18.702593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1187/2440] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:18 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:19.718930 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a66487fc-b01e-4b33-a8c2-74cac106ca74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:19.719532 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a66487fc-b01e-4b33-a8c2-74cac106ca74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:19.726012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a66487fc-b01e-4b33-a8c2-74cac106ca74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:19.726455 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a66487fc-b01e-4b33-a8c2-74cac106ca74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:19.727854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a66487fc-b01e-4b33-a8c2-74cac106ca74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:19.728284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a66487fc-b01e-4b33-a8c2-74cac106ca74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:19.789487 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a66487fc-b01e-4b33-a8c2-74cac106ca74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:19.797630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a66487fc-b01e-4b33-a8c2-74cac106ca74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082480 Jun 20 06:48:19.798187 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1254/2441] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:19 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:20.814239 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e29053a9-5137-4bf0-aa91-c4e88a6af2b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:20.814832 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e29053a9-5137-4bf0-aa91-c4e88a6af2b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:20.822127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e29053a9-5137-4bf0-aa91-c4e88a6af2b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:20.822578 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e29053a9-5137-4bf0-aa91-c4e88a6af2b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:20.823328 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e29053a9-5137-4bf0-aa91-c4e88a6af2b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:20.823761 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e29053a9-5137-4bf0-aa91-c4e88a6af2b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:20.884003 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e29053a9-5137-4bf0-aa91-c4e88a6af2b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:20.891633 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e29053a9-5137-4bf0-aa91-c4e88a6af2b8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081181 Jun 20 06:48:20.892189 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1188/2442] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:20 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:21.908585 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2b890140-5c67-49f3-ac02-ea050a87726e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:21.909198 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2b890140-5c67-49f3-ac02-ea050a87726e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:21.916177 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b890140-5c67-49f3-ac02-ea050a87726e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:21.916620 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b890140-5c67-49f3-ac02-ea050a87726e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:21.917368 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b890140-5c67-49f3-ac02-ea050a87726e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:21.917827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2b890140-5c67-49f3-ac02-ea050a87726e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:21.977452 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2b890140-5c67-49f3-ac02-ea050a87726e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:21.984789 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2b890140-5c67-49f3-ac02-ea050a87726e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080109 Jun 20 06:48:21.985334 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1255/2443] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:21 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:23.002083 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-39048c9d-3935-41bd-9280-c92dcbe793bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:23.002673 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-39048c9d-3935-41bd-9280-c92dcbe793bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:23.004967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:23.011072 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39048c9d-3935-41bd-9280-c92dcbe793bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:23.011797 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39048c9d-3935-41bd-9280-c92dcbe793bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:23.012578 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39048c9d-3935-41bd-9280-c92dcbe793bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:23.013012 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-39048c9d-3935-41bd-9280-c92dcbe793bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:23.077911 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-39048c9d-3935-41bd-9280-c92dcbe793bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:23.085235 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-39048c9d-3935-41bd-9280-c92dcbe793bf tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086966 Jun 20 06:48:23.085826 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1189/2444] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:22 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:24.102000 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45bdd383-d370-4020-a09e-0639e118bde7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:24.102675 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-45bdd383-d370-4020-a09e-0639e118bde7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:24.104932 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:24.110246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45bdd383-d370-4020-a09e-0639e118bde7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:24.110690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45bdd383-d370-4020-a09e-0639e118bde7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:24.111434 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45bdd383-d370-4020-a09e-0639e118bde7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:24.111861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45bdd383-d370-4020-a09e-0639e118bde7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:24.171679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-45bdd383-d370-4020-a09e-0639e118bde7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:24.179017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-45bdd383-d370-4020-a09e-0639e118bde7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080850 Jun 20 06:48:24.179566 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1256/2445] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:24 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:25.195950 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-854a2dcc-c87f-4a1f-a5c7-cbd4d97a8d7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:25.196559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-854a2dcc-c87f-4a1f-a5c7-cbd4d97a8d7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:25.202978 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-854a2dcc-c87f-4a1f-a5c7-cbd4d97a8d7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:25.203422 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-854a2dcc-c87f-4a1f-a5c7-cbd4d97a8d7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:25.204172 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-854a2dcc-c87f-4a1f-a5c7-cbd4d97a8d7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:25.204605 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-854a2dcc-c87f-4a1f-a5c7-cbd4d97a8d7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:25.265091 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-854a2dcc-c87f-4a1f-a5c7-cbd4d97a8d7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:25.272690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-854a2dcc-c87f-4a1f-a5c7-cbd4d97a8d7d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080893 Jun 20 06:48:25.273247 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1190/2446] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:25 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:26.289792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0056f4ac-d1fe-4385-921c-ad04a8d17b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:26.290548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0056f4ac-d1fe-4385-921c-ad04a8d17b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:26.296755 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0056f4ac-d1fe-4385-921c-ad04a8d17b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:26.297199 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0056f4ac-d1fe-4385-921c-ad04a8d17b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:26.297986 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0056f4ac-d1fe-4385-921c-ad04a8d17b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:26.298415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0056f4ac-d1fe-4385-921c-ad04a8d17b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:26.302200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:26.359185 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0056f4ac-d1fe-4385-921c-ad04a8d17b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:26.366572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0056f4ac-d1fe-4385-921c-ad04a8d17b74 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081192 Jun 20 06:48:26.367134 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1257/2447] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:26 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:27.384504 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ca363bf3-ca18-4f6d-908e-929f63704440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:27.385109 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ca363bf3-ca18-4f6d-908e-929f63704440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:27.391848 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca363bf3-ca18-4f6d-908e-929f63704440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:27.392292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca363bf3-ca18-4f6d-908e-929f63704440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:27.393045 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca363bf3-ca18-4f6d-908e-929f63704440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:27.393503 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca363bf3-ca18-4f6d-908e-929f63704440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:27.457410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ca363bf3-ca18-4f6d-908e-929f63704440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:27.465713 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ca363bf3-ca18-4f6d-908e-929f63704440 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085425 Jun 20 06:48:27.466285 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1191/2448] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:27 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:28.482591 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9c127e09-a461-4389-b261-f2b2d27ac1f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:28.483203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9c127e09-a461-4389-b261-f2b2d27ac1f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:28.489726 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c127e09-a461-4389-b261-f2b2d27ac1f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:28.490186 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c127e09-a461-4389-b261-f2b2d27ac1f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:28.490948 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c127e09-a461-4389-b261-f2b2d27ac1f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:28.491386 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c127e09-a461-4389-b261-f2b2d27ac1f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:28.553905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9c127e09-a461-4389-b261-f2b2d27ac1f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:28.561795 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9c127e09-a461-4389-b261-f2b2d27ac1f9 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083074 Jun 20 06:48:28.562353 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1258/2449] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:28 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:29.578870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a1910a51-0504-49a0-82d5-164229734a5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:29.579469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a1910a51-0504-49a0-82d5-164229734a5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:29.586753 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1910a51-0504-49a0-82d5-164229734a5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:29.587377 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1910a51-0504-49a0-82d5-164229734a5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:29.588694 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1910a51-0504-49a0-82d5-164229734a5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:29.589520 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a1910a51-0504-49a0-82d5-164229734a5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:29.652304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a1910a51-0504-49a0-82d5-164229734a5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:29.659756 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a1910a51-0504-49a0-82d5-164229734a5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084758 Jun 20 06:48:29.660312 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1192/2450] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:29 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:30.677068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cf923c74-041d-4f05-87f0-277ebfa0d2a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:30.677702 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cf923c74-041d-4f05-87f0-277ebfa0d2a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:30.685009 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf923c74-041d-4f05-87f0-277ebfa0d2a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:30.685570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf923c74-041d-4f05-87f0-277ebfa0d2a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:30.686336 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf923c74-041d-4f05-87f0-277ebfa0d2a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:30.686849 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf923c74-041d-4f05-87f0-277ebfa0d2a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:30.747283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cf923c74-041d-4f05-87f0-277ebfa0d2a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:30.754984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cf923c74-041d-4f05-87f0-277ebfa0d2a6 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081839 Jun 20 06:48:30.755559 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1259/2451] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:30 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:31.771990 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e70304a9-24c3-4dee-bc25-9f990e6362d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:31.772602 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e70304a9-24c3-4dee-bc25-9f990e6362d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:31.779169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e70304a9-24c3-4dee-bc25-9f990e6362d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:31.779624 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e70304a9-24c3-4dee-bc25-9f990e6362d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:31.780379 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e70304a9-24c3-4dee-bc25-9f990e6362d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:31.780815 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e70304a9-24c3-4dee-bc25-9f990e6362d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:31.842443 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e70304a9-24c3-4dee-bc25-9f990e6362d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:31.849780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e70304a9-24c3-4dee-bc25-9f990e6362d8 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081596 Jun 20 06:48:31.850345 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1193/2452] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:31 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:32.866807 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eb773611-c96b-4549-807c-c19d6ff00811 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:32.867465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eb773611-c96b-4549-807c-c19d6ff00811 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:32.874606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb773611-c96b-4549-807c-c19d6ff00811 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:32.875055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb773611-c96b-4549-807c-c19d6ff00811 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:32.875803 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb773611-c96b-4549-807c-c19d6ff00811 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:32.876229 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eb773611-c96b-4549-807c-c19d6ff00811 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:32.938007 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eb773611-c96b-4549-807c-c19d6ff00811 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:32.945857 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eb773611-c96b-4549-807c-c19d6ff00811 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082381 Jun 20 06:48:32.946401 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1260/2453] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:32 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:33.963687 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0b6f4e26-18c0-45dd-ab6f-1987325dbbba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:33.964320 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0b6f4e26-18c0-45dd-ab6f-1987325dbbba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:33.970970 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b6f4e26-18c0-45dd-ab6f-1987325dbbba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:33.971417 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b6f4e26-18c0-45dd-ab6f-1987325dbbba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:33.972202 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b6f4e26-18c0-45dd-ab6f-1987325dbbba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:33.972634 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b6f4e26-18c0-45dd-ab6f-1987325dbbba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:34.034589 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0b6f4e26-18c0-45dd-ab6f-1987325dbbba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:34.042394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0b6f4e26-18c0-45dd-ab6f-1987325dbbba tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083634 Jun 20 06:48:34.042962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1194/2454] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:33 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:35.059410 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0350271e-9b0f-47b8-9d2a-be8da9753b82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:35.060015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0350271e-9b0f-47b8-9d2a-be8da9753b82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:35.066415 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0350271e-9b0f-47b8-9d2a-be8da9753b82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:35.066865 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0350271e-9b0f-47b8-9d2a-be8da9753b82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:35.067612 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0350271e-9b0f-47b8-9d2a-be8da9753b82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:35.068044 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0350271e-9b0f-47b8-9d2a-be8da9753b82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:35.129486 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0350271e-9b0f-47b8-9d2a-be8da9753b82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:35.138203 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0350271e-9b0f-47b8-9d2a-be8da9753b82 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082646 Jun 20 06:48:35.138757 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1261/2455] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:35 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:36.154623 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-397d25b4-7a81-40ee-8901-c13da405295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:36.155263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-397d25b4-7a81-40ee-8901-c13da405295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:36.161851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-397d25b4-7a81-40ee-8901-c13da405295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:36.162302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-397d25b4-7a81-40ee-8901-c13da405295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:36.163061 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-397d25b4-7a81-40ee-8901-c13da405295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:36.163518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-397d25b4-7a81-40ee-8901-c13da405295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:36.224967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-397d25b4-7a81-40ee-8901-c13da405295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:36.233047 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-397d25b4-7a81-40ee-8901-c13da405295a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082295 Jun 20 06:48:36.233657 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1195/2456] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:36 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:37.250877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-35334eba-eead-447e-8a24-5bef10fb5a70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:37.251480 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-35334eba-eead-447e-8a24-5bef10fb5a70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:37.258547 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35334eba-eead-447e-8a24-5bef10fb5a70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:37.258990 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35334eba-eead-447e-8a24-5bef10fb5a70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:37.259737 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35334eba-eead-447e-8a24-5bef10fb5a70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:37.260167 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35334eba-eead-447e-8a24-5bef10fb5a70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:37.322361 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-35334eba-eead-447e-8a24-5bef10fb5a70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:37.329905 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-35334eba-eead-447e-8a24-5bef10fb5a70 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082854 Jun 20 06:48:37.330465 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1262/2457] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:37 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:38.347367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d0c6fe5e-aecf-409a-8dfe-cf4c053c0c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:38.347981 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d0c6fe5e-aecf-409a-8dfe-cf4c053c0c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:38.354758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0c6fe5e-aecf-409a-8dfe-cf4c053c0c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:38.355212 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0c6fe5e-aecf-409a-8dfe-cf4c053c0c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:38.355980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0c6fe5e-aecf-409a-8dfe-cf4c053c0c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:38.356415 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d0c6fe5e-aecf-409a-8dfe-cf4c053c0c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:38.418659 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d0c6fe5e-aecf-409a-8dfe-cf4c053c0c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:38.426165 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d0c6fe5e-aecf-409a-8dfe-cf4c053c0c5b tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082692 Jun 20 06:48:38.426764 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1196/2458] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:38 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:39.443372 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8c6d3293-6169-4b17-b808-73aee6f82633 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:39.443980 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8c6d3293-6169-4b17-b808-73aee6f82633 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:39.450868 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c6d3293-6169-4b17-b808-73aee6f82633 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:39.451320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c6d3293-6169-4b17-b808-73aee6f82633 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:39.452072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c6d3293-6169-4b17-b808-73aee6f82633 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:39.452507 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8c6d3293-6169-4b17-b808-73aee6f82633 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:39.513302 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8c6d3293-6169-4b17-b808-73aee6f82633 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:39.520718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8c6d3293-6169-4b17-b808-73aee6f82633 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081173 Jun 20 06:48:39.521281 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1263/2459] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:39 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:40.537548 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33ee067e-7bdc-4898-9cdc-c8566ff3abfc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:40.538146 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-33ee067e-7bdc-4898-9cdc-c8566ff3abfc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:40.545034 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33ee067e-7bdc-4898-9cdc-c8566ff3abfc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:40.545516 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33ee067e-7bdc-4898-9cdc-c8566ff3abfc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:40.546264 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33ee067e-7bdc-4898-9cdc-c8566ff3abfc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:40.546695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33ee067e-7bdc-4898-9cdc-c8566ff3abfc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:40.611669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-33ee067e-7bdc-4898-9cdc-c8566ff3abfc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:40.619913 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-33ee067e-7bdc-4898-9cdc-c8566ff3abfc tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086197 Jun 20 06:48:40.620484 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1197/2460] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:40 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:41.637309 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6b67c0fd-b9a8-4c65-a019-65a9af0aad11 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:41.638045 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6b67c0fd-b9a8-4c65-a019-65a9af0aad11 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:41.644493 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b67c0fd-b9a8-4c65-a019-65a9af0aad11 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:41.644941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b67c0fd-b9a8-4c65-a019-65a9af0aad11 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:41.645733 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b67c0fd-b9a8-4c65-a019-65a9af0aad11 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:41.646170 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b67c0fd-b9a8-4c65-a019-65a9af0aad11 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:41.945724 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6b67c0fd-b9a8-4c65-a019-65a9af0aad11 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:41.953258 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6b67c0fd-b9a8-4c65-a019-65a9af0aad11 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.321068 Jun 20 06:48:41.953843 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1264/2461] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:41 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:42.969996 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3a821000-fb10-4cd0-9c0f-c824978dd54d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:42.970594 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3a821000-fb10-4cd0-9c0f-c824978dd54d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:42.978901 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a821000-fb10-4cd0-9c0f-c824978dd54d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:42.979349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a821000-fb10-4cd0-9c0f-c824978dd54d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:42.980105 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a821000-fb10-4cd0-9c0f-c824978dd54d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:42.980539 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3a821000-fb10-4cd0-9c0f-c824978dd54d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:43.045284 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3a821000-fb10-4cd0-9c0f-c824978dd54d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:43.052875 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3a821000-fb10-4cd0-9c0f-c824978dd54d tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086753 Jun 20 06:48:43.053457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1198/2462] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:42 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:44.069294 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d2aa931c-af4d-4efe-98db-ba9e5ad5f1aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:44.069881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d2aa931c-af4d-4efe-98db-ba9e5ad5f1aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:44.076873 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2aa931c-af4d-4efe-98db-ba9e5ad5f1aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:44.077324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2aa931c-af4d-4efe-98db-ba9e5ad5f1aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:44.078103 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2aa931c-af4d-4efe-98db-ba9e5ad5f1aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:44.078540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d2aa931c-af4d-4efe-98db-ba9e5ad5f1aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:44.140804 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d2aa931c-af4d-4efe-98db-ba9e5ad5f1aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:44.148204 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d2aa931c-af4d-4efe-98db-ba9e5ad5f1aa tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082801 Jun 20 06:48:44.148759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1265/2463] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:44 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:45.163973 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89af0b71-e9e3-4c4a-9ecb-461da6dd4086 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:45.164758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-89af0b71-e9e3-4c4a-9ecb-461da6dd4086 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:45.171063 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89af0b71-e9e3-4c4a-9ecb-461da6dd4086 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:45.171510 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89af0b71-e9e3-4c4a-9ecb-461da6dd4086 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:45.172255 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89af0b71-e9e3-4c4a-9ecb-461da6dd4086 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:45.172686 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89af0b71-e9e3-4c4a-9ecb-461da6dd4086 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:45.176499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:45.234799 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-89af0b71-e9e3-4c4a-9ecb-461da6dd4086 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:45.242298 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89af0b71-e9e3-4c4a-9ecb-461da6dd4086 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.082192 Jun 20 06:48:45.243489 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1199/2464] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:45 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:46.260626 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2691e632-f878-4a54-9d0c-9dde537ba262 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:46.261509 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2691e632-f878-4a54-9d0c-9dde537ba262 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:46.267941 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2691e632-f878-4a54-9d0c-9dde537ba262 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:46.268388 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2691e632-f878-4a54-9d0c-9dde537ba262 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:46.269143 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2691e632-f878-4a54-9d0c-9dde537ba262 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:46.269606 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2691e632-f878-4a54-9d0c-9dde537ba262 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:46.332953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2691e632-f878-4a54-9d0c-9dde537ba262 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:46.340560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2691e632-f878-4a54-9d0c-9dde537ba262 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.084818 Jun 20 06:48:46.341106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1266/2465] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:46 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:47.359005 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b896da0f-27bc-4258-8583-0290d7ea1ec0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:47.359621 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b896da0f-27bc-4258-8583-0290d7ea1ec0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:47.368048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b896da0f-27bc-4258-8583-0290d7ea1ec0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:47.368500 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b896da0f-27bc-4258-8583-0290d7ea1ec0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:47.369306 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b896da0f-27bc-4258-8583-0290d7ea1ec0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:47.369760 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b896da0f-27bc-4258-8583-0290d7ea1ec0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:47.434011 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b896da0f-27bc-4258-8583-0290d7ea1ec0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:47.441527 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b896da0f-27bc-4258-8583-0290d7ea1ec0 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.087858 Jun 20 06:48:47.442089 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1200/2466] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:47 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:48.459414 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-567a7709-b8f9-41d5-9224-6ca89b4a6c5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:48.460005 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-567a7709-b8f9-41d5-9224-6ca89b4a6c5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:48.466934 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-567a7709-b8f9-41d5-9224-6ca89b4a6c5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:48.467381 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-567a7709-b8f9-41d5-9224-6ca89b4a6c5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:48.468136 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-567a7709-b8f9-41d5-9224-6ca89b4a6c5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:48.468571 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-567a7709-b8f9-41d5-9224-6ca89b4a6c5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:48.528891 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-567a7709-b8f9-41d5-9224-6ca89b4a6c5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:48.536249 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-567a7709-b8f9-41d5-9224-6ca89b4a6c5c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080721 Jun 20 06:48:48.536800 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1267/2467] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:48 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:49.553877 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-34850006-8162-4b73-8001-f2ec4c938a77 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:49.554493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-34850006-8162-4b73-8001-f2ec4c938a77 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:49.561365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34850006-8162-4b73-8001-f2ec4c938a77 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:49.561842 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34850006-8162-4b73-8001-f2ec4c938a77 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:49.562593 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34850006-8162-4b73-8001-f2ec4c938a77 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:49.563028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34850006-8162-4b73-8001-f2ec4c938a77 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:49.623793 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-34850006-8162-4b73-8001-f2ec4c938a77 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:49.631201 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-34850006-8162-4b73-8001-f2ec4c938a77 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081177 Jun 20 06:48:49.631766 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1201/2468] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:49 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:50.650081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e3c242f0-4ea9-4d03-8df4-8a795620abc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:50.650684 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e3c242f0-4ea9-4d03-8df4-8a795620abc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:50.657117 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3c242f0-4ea9-4d03-8df4-8a795620abc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:50.657599 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3c242f0-4ea9-4d03-8df4-8a795620abc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:50.658346 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3c242f0-4ea9-4d03-8df4-8a795620abc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:50.658774 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3c242f0-4ea9-4d03-8df4-8a795620abc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:50.720820 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e3c242f0-4ea9-4d03-8df4-8a795620abc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:50.728836 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e3c242f0-4ea9-4d03-8df4-8a795620abc1 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.083234 Jun 20 06:48:50.729400 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1268/2469] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:50 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:51.745692 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8c82027-1cea-4a11-8af8-72bf4482565c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:51.746300 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8c82027-1cea-4a11-8af8-72bf4482565c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:51.752718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8c82027-1cea-4a11-8af8-72bf4482565c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:51.753169 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8c82027-1cea-4a11-8af8-72bf4482565c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:51.753974 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8c82027-1cea-4a11-8af8-72bf4482565c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:51.754413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8c82027-1cea-4a11-8af8-72bf4482565c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:51.815394 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8c82027-1cea-4a11-8af8-72bf4482565c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:51.823351 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8c82027-1cea-4a11-8af8-72bf4482565c tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081554 Jun 20 06:48:51.823916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1202/2470] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:51 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:52.840464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f7a4e605-4780-42d9-95a0-057eef4fe8a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:52.841066 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f7a4e605-4780-42d9-95a0-057eef4fe8a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:52.847623 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f7a4e605-4780-42d9-95a0-057eef4fe8a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:52.848063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f7a4e605-4780-42d9-95a0-057eef4fe8a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:52.848815 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f7a4e605-4780-42d9-95a0-057eef4fe8a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:52.849244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f7a4e605-4780-42d9-95a0-057eef4fe8a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:52.908732 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f7a4e605-4780-42d9-95a0-057eef4fe8a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:52.916122 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f7a4e605-4780-42d9-95a0-057eef4fe8a7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.079742 Jun 20 06:48:52.916673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1269/2471] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:52 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:53.932173 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0961f39e-6d8a-4285-9045-0cbaf93779b7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:53.932780 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0961f39e-6d8a-4285-9045-0cbaf93779b7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:53.935167 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=28 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:53.940689 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0961f39e-6d8a-4285-9045-0cbaf93779b7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:53.941133 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0961f39e-6d8a-4285-9045-0cbaf93779b7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:53.941962 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0961f39e-6d8a-4285-9045-0cbaf93779b7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:53.942396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0961f39e-6d8a-4285-9045-0cbaf93779b7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:54.004802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0961f39e-6d8a-4285-9045-0cbaf93779b7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:54.013271 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0961f39e-6d8a-4285-9045-0cbaf93779b7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.085092 Jun 20 06:48:54.013870 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1203/2472] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:53 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:55.032540 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-84608711-36bf-491d-885f-f7c58b549bed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:55.033235 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-84608711-36bf-491d-885f-f7c58b549bed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:55.035447 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:55.040816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84608711-36bf-491d-885f-f7c58b549bed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:55.041272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84608711-36bf-491d-885f-f7c58b549bed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:55.042129 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84608711-36bf-491d-885f-f7c58b549bed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:55.042570 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84608711-36bf-491d-885f-f7c58b549bed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:55.105759 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-84608711-36bf-491d-885f-f7c58b549bed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:55.113224 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-84608711-36bf-491d-885f-f7c58b549bed tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.086284 Jun 20 06:48:55.113811 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1270/2473] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:55 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:56.130852 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8f32e006-651b-4cdc-92c8-77f312acb93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:56.131488 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8f32e006-651b-4cdc-92c8-77f312acb93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:56.138685 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f32e006-651b-4cdc-92c8-77f312acb93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:56.139129 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f32e006-651b-4cdc-92c8-77f312acb93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:56.139881 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f32e006-651b-4cdc-92c8-77f312acb93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:56.140317 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f32e006-651b-4cdc-92c8-77f312acb93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:56.199762 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8f32e006-651b-4cdc-92c8-77f312acb93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:56.207110 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8f32e006-651b-4cdc-92c8-77f312acb93a tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.080102 Jun 20 06:48:56.207669 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1204/2474] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:56 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:57.225297 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9814f956-3bf8-47e3-9758-969727236337 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:57.225953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9814f956-3bf8-47e3-9758-969727236337 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:57.232861 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9814f956-3bf8-47e3-9758-969727236337 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:57.233308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9814f956-3bf8-47e3-9758-969727236337 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:57.234094 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9814f956-3bf8-47e3-9758-969727236337 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:57.234522 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9814f956-3bf8-47e3-9758-969727236337 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:57.236962 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=84 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:48:57.296047 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9814f956-3bf8-47e3-9758-969727236337 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:57.303378 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9814f956-3bf8-47e3-9758-969727236337 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081964 Jun 20 06:48:57.303928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1271/2475] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:57 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:58.320675 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-308d6568-a936-4b07-895c-ab5d8d3cb207 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:58.321395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-308d6568-a936-4b07-895c-ab5d8d3cb207 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:58.328026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-308d6568-a936-4b07-895c-ab5d8d3cb207 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:58.328474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-308d6568-a936-4b07-895c-ab5d8d3cb207 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:58.329229 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-308d6568-a936-4b07-895c-ab5d8d3cb207 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:58.329690 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-308d6568-a936-4b07-895c-ab5d8d3cb207 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:58.390695 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-308d6568-a936-4b07-895c-ab5d8d3cb207 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:58.398205 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-308d6568-a936-4b07-895c-ab5d8d3cb207 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.081883 Jun 20 06:48:58.399395 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1205/2476] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:58 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:59.415938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-225eb24b-8cf0-4300-a8b8-e4484fae715e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:59.416561 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-225eb24b-8cf0-4300-a8b8-e4484fae715e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 32410ddb-881f-46f6-b3c6-67399fd5b53b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:59.423194 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-225eb24b-8cf0-4300-a8b8-e4484fae715e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:59.423644 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-225eb24b-8cf0-4300-a8b8-e4484fae715e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:59.424441 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-225eb24b-8cf0-4300-a8b8-e4484fae715e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:59.424879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-225eb24b-8cf0-4300-a8b8-e4484fae715e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:59.490716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-225eb24b-8cf0-4300-a8b8-e4484fae715e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577abe1ada45979d5cb550073ae6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80966bf28184a9f8e9987632f7c0973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:48:59.499018 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-225eb24b-8cf0-4300-a8b8-e4484fae715e tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b" status: 200 len: 1390 microversion: 2.1 time: 0.087223 Jun 20 06:48:59.499598 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1272/2477] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:59 2022] GET /compute/v2.1/servers/32410ddb-881f-46f6-b3c6-67399fd5b53b => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:48:59.958804 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:59.959311 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:48:59.966125 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:59.966581 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:59.967381 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:48:59.967819 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:48:59.981632 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] HTTP exception thrown: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Request method failure captured: Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 HTTP/1.1 Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBBIcSH4qKhgDIC_c3zXiIPeDkT9cv9-cQzj4rb7_8kV9rdFCtVvM02VJ_3jWEDol9CucUcxnaYa2-JgFnAyD1yCot3qkKNZOC_pWkKjREP6M0ye9dLovRnB4uwzc33WKi4X7IHo_RQuBXbYWEiAaZmtSSyMYywmuWz_gyoZRi7r9Dg Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: a80966bf28184a9f8e9987632f7c0973 Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-TestVolumeBootPattern-728897810 Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:48:59.983302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a80966bf28184a9f8e9987632f7c0973"}]}] Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-TestVolumeBootPattern-728897810 Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: a80966bf28184a9f8e9987632f7c0973 Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-TestVolumeBootPattern-728897810 Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-TestVolumeBootPattern-728897810-project Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 6f577abe1ada45979d5cb550073ae6a8 Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-TestVolumeBootPattern-728897810-project Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:48:59.985259 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '3b98adf6-82cd-42e0-b795-1bffcbe0f936'} Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:48:59.986336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:48:59.988081 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:48:59.989925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Returning 404 to user: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:48:59.989925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee91b2bd-9c0c-4c96-a030-597ec250b0e7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 404 len: 111 microversion: 2.1 time: 0.029743 Jun 20 06:48:59.989925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1206/2478] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:48:59 2022] DELETE /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:48:59.994016 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:48:59.994649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] [instance: 3b98adf6-82cd-42e0-b795-1bffcbe0f936] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:49:00.000479 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:49:00.000920 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:49:00.001691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:49:00.002120 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:49:00.015335 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] HTTP exception thrown: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Request method failure captured: Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 HTTP/1.1 Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBBIcSH4qKhgDIC_c3zXiIPeDkT9cv9-cQzj4rb7_8kV9rdFCtVvM02VJ_3jWEDol9CucUcxnaYa2-JgFnAyD1yCot3qkKNZOC_pWkKjREP6M0ye9dLovRnB4uwzc33WKi4X7IHo_RQuBXbYWEiAaZmtSSyMYywmuWz_gyoZRi7r9Dg Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: a80966bf28184a9f8e9987632f7c0973 Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-TestVolumeBootPattern-728897810 Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:49:00.016827 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a80966bf28184a9f8e9987632f7c0973"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a80966bf28184a9f8e9987632f7c0973"}]}] Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-TestVolumeBootPattern-728897810 Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: a80966bf28184a9f8e9987632f7c0973 Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-TestVolumeBootPattern-728897810 Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-TestVolumeBootPattern-728897810-project Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 6f577abe1ada45979d5cb550073ae6a8 Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-TestVolumeBootPattern-728897810-project Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:49:00.018689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '3b98adf6-82cd-42e0-b795-1bffcbe0f936'} Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:49:00.019860 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. Jun 20 06:49:00.021657 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:49:00.023300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Returning 404 to user: Instance 3b98adf6-82cd-42e0-b795-1bffcbe0f936 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:49:00.023300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-caf8d2ef-ab07-4c5e-b38e-e9dc73ae38d7 tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936" status: 404 len: 111 microversion: 2.1 time: 0.028774 Jun 20 06:49:00.023300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1273/2479] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:48:59 2022] GET /compute/v2.1/servers/3b98adf6-82cd-42e0-b795-1bffcbe0f936 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:49:40.125696 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:49:40.126422 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:49:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:50:00.551479 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:50:00.552087 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:50:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:51:17.579126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:51:17.579748 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:51:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:51:19.815413 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:51:19.816001 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:51:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:51:38.352274 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:51:38.352735 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:51:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:53:00.134639 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:53:00.135621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:53:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:53:20.560028 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:53:20.560630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:53:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:54:14.726256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR oslo.messaging._drivers.impl_rabbit [-] [557af53d-f1d8-4887-a0a2-d1b46a31c204] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 06:54:14.726897 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=7 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:14.727574 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=43 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:14.731423 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-721740333", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452", "networks": [{"uuid": "4ebe20bb-cc19-4a24-9e9e-399319f18128"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:14.973658 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] validate_networks() for [('4ebe20bb-cc19-4a24-9e9e-399319f18128', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:54:15.433098 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:54:15.433557 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:54:15.434026 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:54:15.434431 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:54:15.434833 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:54:15.445048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:15.445533 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:15.446318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:15.446750 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:15.462706 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Getting quotas for project ef4cdcfeeefd4d598f28a1316087944f. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:54:15.466564 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Getting quotas for user 0a38dccab9404882be501aeb64a228f6 and project ef4cdcfeeefd4d598f28a1316087944f. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:54:15.477245 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:54:15.480270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:54:15.532037 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e64f471d-dbe9-4f2f-94af-0d3f3c147329 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807520 Jun 20 06:54:15.538238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1207/2480] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:54:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:54:15.541223 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c15751c-5f22-4f59-afa3-4af5e42d1c9c] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 06:54:15.542062 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=7 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:15.542792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=13 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:15.546655 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d2c0af40-090d-4733-9fe3-42629c2f2520 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:15.547270 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d2c0af40-090d-4733-9fe3-42629c2f2520 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:15.665012 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d2c0af40-090d-4733-9fe3-42629c2f2520 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:15.672171 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d2c0af40-090d-4733-9fe3-42629c2f2520 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1218 microversion: 2.1 time: 0.132763 Jun 20 06:54:15.681970 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1274/2481] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:15 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:16.688859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d6d56e4-4bbd-499b-b810-86f4b70fea3f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:16.690270 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d6d56e4-4bbd-499b-b810-86f4b70fea3f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:16.698238 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d6d56e4-4bbd-499b-b810-86f4b70fea3f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:16.698696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d6d56e4-4bbd-499b-b810-86f4b70fea3f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:16.699466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d6d56e4-4bbd-499b-b810-86f4b70fea3f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:16.699904 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d6d56e4-4bbd-499b-b810-86f4b70fea3f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:16.721372 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] [557af53d-f1d8-4887-a0a2-d1b46a31c204] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46440. Jun 20 06:54:16.776721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d6d56e4-4bbd-499b-b810-86f4b70fea3f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:16.789698 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d6d56e4-4bbd-499b-b810-86f4b70fea3f tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1278 microversion: 2.1 time: 0.104554 Jun 20 06:54:16.790938 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1208/2482] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:16 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:17.807560 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d82d9a68-a781-48db-b082-d49ee0d9f61c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:17.808160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d82d9a68-a781-48db-b082-d49ee0d9f61c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:17.815799 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d82d9a68-a781-48db-b082-d49ee0d9f61c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:17.816247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d82d9a68-a781-48db-b082-d49ee0d9f61c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:17.817015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d82d9a68-a781-48db-b082-d49ee0d9f61c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:17.817469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d82d9a68-a781-48db-b082-d49ee0d9f61c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:17.835190 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c15751c-5f22-4f59-afa3-4af5e42d1c9c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46454. Jun 20 06:54:18.057953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d82d9a68-a781-48db-b082-d49ee0d9f61c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:18.066202 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d82d9a68-a781-48db-b082-d49ee0d9f61c tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1318 microversion: 2.1 time: 0.262877 Jun 20 06:54:18.067308 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1275/2483] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:17 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:18.303925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-37cd81a0-1ccb-414c-9e0a-6456b0133f01 req-0f478bd3-1b7f-41e3-8971-7d12f9567a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187af4c6-b9e1-4bd3-8541-ea34e4e3b209", "tag": "692b38e4-e689-4aa1-a530-33c12e060a4c"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:18.320361 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-37cd81a0-1ccb-414c-9e0a-6456b0133f01 req-0f478bd3-1b7f-41e3-8971-7d12f9567a8d service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:18.320697 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-37cd81a0-1ccb-414c-9e0a-6456b0133f01 req-0f478bd3-1b7f-41e3-8971-7d12f9567a8d service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:18.339185 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-37cd81a0-1ccb-414c-9e0a-6456b0133f01 req-0f478bd3-1b7f-41e3-8971-7d12f9567a8d service nova] Creating event network-changed:692b38e4-e689-4aa1-a530-33c12e060a4c for instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 on hv-cinder-80473 Jun 20 06:54:18.345570 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-37cd81a0-1ccb-414c-9e0a-6456b0133f01 req-0f478bd3-1b7f-41e3-8971-7d12f9567a8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119313 Jun 20 06:54:18.346615 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1209/2484] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:54:19.083694 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e94faa4c-bf83-422b-af3e-7f14052cd653 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:19.084330 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e94faa4c-bf83-422b-af3e-7f14052cd653 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:19.090477 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e94faa4c-bf83-422b-af3e-7f14052cd653 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:19.090928 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e94faa4c-bf83-422b-af3e-7f14052cd653 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:19.091684 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e94faa4c-bf83-422b-af3e-7f14052cd653 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:19.092124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e94faa4c-bf83-422b-af3e-7f14052cd653 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:19.222581 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e94faa4c-bf83-422b-af3e-7f14052cd653 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:19.229938 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e94faa4c-bf83-422b-af3e-7f14052cd653 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1318 microversion: 2.1 time: 0.150617 Jun 20 06:54:19.230497 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1276/2485] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:19 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:20.248914 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6ac4d11f-97ad-420f-b6f2-f965580e4f43 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:20.250152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6ac4d11f-97ad-420f-b6f2-f965580e4f43 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:20.257181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ac4d11f-97ad-420f-b6f2-f965580e4f43 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:20.257625 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ac4d11f-97ad-420f-b6f2-f965580e4f43 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:20.258436 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ac4d11f-97ad-420f-b6f2-f965580e4f43 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:20.258883 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6ac4d11f-97ad-420f-b6f2-f965580e4f43 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:20.399851 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6ac4d11f-97ad-420f-b6f2-f965580e4f43 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:20.410498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6ac4d11f-97ad-420f-b6f2-f965580e4f43 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1318 microversion: 2.1 time: 0.166276 Jun 20 06:54:20.411399 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1210/2486] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:20 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:21.428055 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5c6aaa57-714f-4c06-94bf-a1fe861fa0e2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:21.428673 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5c6aaa57-714f-4c06-94bf-a1fe861fa0e2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:21.436287 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c6aaa57-714f-4c06-94bf-a1fe861fa0e2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:21.436761 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c6aaa57-714f-4c06-94bf-a1fe861fa0e2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:21.437543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c6aaa57-714f-4c06-94bf-a1fe861fa0e2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:21.437984 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c6aaa57-714f-4c06-94bf-a1fe861fa0e2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:21.574124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5c6aaa57-714f-4c06-94bf-a1fe861fa0e2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:21.582283 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5c6aaa57-714f-4c06-94bf-a1fe861fa0e2 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1318 microversion: 2.1 time: 0.158195 Jun 20 06:54:21.582854 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1277/2487] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:21 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:22.509186 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1310867328", "imageRef": "588a6431-ac19-4d11-8677-626d76ae4f9d", "flavorRef": "452"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:22.561148 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] validate_networks() for None {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:54:22.598877 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2f1c3a9e-0bb1-4ae6-9e1e-7e84c4b04a40 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:22.599625 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2f1c3a9e-0bb1-4ae6-9e1e-7e84c4b04a40 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:22.606197 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f1c3a9e-0bb1-4ae6-9e1e-7e84c4b04a40 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:22.606630 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f1c3a9e-0bb1-4ae6-9e1e-7e84c4b04a40 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:22.607426 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f1c3a9e-0bb1-4ae6-9e1e-7e84c4b04a40 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:22.607887 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f1c3a9e-0bb1-4ae6-9e1e-7e84c4b04a40 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:22.886395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2f1c3a9e-0bb1-4ae6-9e1e-7e84c4b04a40 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:22.894979 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2f1c3a9e-0bb1-4ae6-9e1e-7e84c4b04a40 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1318 microversion: 2.1 time: 0.299958 Jun 20 06:54:22.895839 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1278/2488] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:22 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:54:22.917192 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:54:22.917648 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:54:22.918152 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:54:22.918555 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:54:22.918964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:54:22.928483 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:22.928932 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:22.929746 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:22.930181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:22.946356 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Getting quotas for project 51931e260aae426b93a7868048b03f55. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:54:22.950243 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Getting quotas for user 269859b4844d4e8bb44315064eb4af77 and project 51931e260aae426b93a7868048b03f55. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:54:22.961608 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:54:22.963859 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='588a6431-ac19-4d11-8677-626d76ae4f9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:54:23.009272 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-166eae8b-1259-42df-a6c9-20dab68e223c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503840 Jun 20 06:54:23.010210 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1211/2489] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jun 20 06:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:54:23.020017 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-229fa4a7-8ede-4ab6-a233-654506918bb6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:23.020628 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-229fa4a7-8ede-4ab6-a233-654506918bb6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:23.072621 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-229fa4a7-8ede-4ab6-a233-654506918bb6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:23.079160 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-229fa4a7-8ede-4ab6-a233-654506918bb6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1215 microversion: 2.1 time: 0.063050 Jun 20 06:54:23.079725 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1279/2490] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:23 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:23.912886 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5fb51dd6-6ff3-43e9-8138-676c7d30194e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:23.913529 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5fb51dd6-6ff3-43e9-8138-676c7d30194e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:23.919676 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fb51dd6-6ff3-43e9-8138-676c7d30194e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:23.920130 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fb51dd6-6ff3-43e9-8138-676c7d30194e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:23.920889 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fb51dd6-6ff3-43e9-8138-676c7d30194e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:23.921333 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fb51dd6-6ff3-43e9-8138-676c7d30194e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:24.049802 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fb51dd6-6ff3-43e9-8138-676c7d30194e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:24.057318 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5fb51dd6-6ff3-43e9-8138-676c7d30194e tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1318 microversion: 2.1 time: 0.148763 Jun 20 06:54:24.057937 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1212/2491] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:23 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:24.098119 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0ca2ff40-5cd9-4b06-95b0-ed64d56d9a77 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:24.098747 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0ca2ff40-5cd9-4b06-95b0-ed64d56d9a77 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:24.160773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0ca2ff40-5cd9-4b06-95b0-ed64d56d9a77 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:24.167524 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0ca2ff40-5cd9-4b06-95b0-ed64d56d9a77 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1215 microversion: 2.1 time: 0.074858 Jun 20 06:54:24.168024 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1280/2492] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:24 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:24.541137 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-69afe003-e80e-438c-89e4-80acf00f3db1 req-798f5e79-6290-4552-b39a-384fd208056e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187af4c6-b9e1-4bd3-8541-ea34e4e3b209", "name": "network-vif-plugged", "status": "completed", "tag": "692b38e4-e689-4aa1-a530-33c12e060a4c"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:24.549782 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-69afe003-e80e-438c-89e4-80acf00f3db1 req-798f5e79-6290-4552-b39a-384fd208056e service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:24.550230 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-69afe003-e80e-438c-89e4-80acf00f3db1 req-798f5e79-6290-4552-b39a-384fd208056e service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:24.560758 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-69afe003-e80e-438c-89e4-80acf00f3db1 req-798f5e79-6290-4552-b39a-384fd208056e service nova] Creating event network-vif-plugged:692b38e4-e689-4aa1-a530-33c12e060a4c for instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 on hv-cinder-80473 Jun 20 06:54:24.566514 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-69afe003-e80e-438c-89e4-80acf00f3db1 req-798f5e79-6290-4552-b39a-384fd208056e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155065 Jun 20 06:54:24.567098 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1213/2493] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:54:25.073915 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-93c92395-eeae-4b6b-9660-de945fb984fe tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:25.074453 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-93c92395-eeae-4b6b-9660-de945fb984fe tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:25.081126 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93c92395-eeae-4b6b-9660-de945fb984fe tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:25.081609 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93c92395-eeae-4b6b-9660-de945fb984fe tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:25.082373 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93c92395-eeae-4b6b-9660-de945fb984fe tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:25.082814 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93c92395-eeae-4b6b-9660-de945fb984fe tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:25.189153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-44f1b7be-0a74-4c19-80db-116cf3c098a3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:25.190023 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-44f1b7be-0a74-4c19-80db-116cf3c098a3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:25.218719 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-93c92395-eeae-4b6b-9660-de945fb984fe tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:25.227128 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-93c92395-eeae-4b6b-9660-de945fb984fe tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1318 microversion: 2.1 time: 0.157103 Jun 20 06:54:25.227893 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1281/2494] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:25 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:25.250139 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-44f1b7be-0a74-4c19-80db-116cf3c098a3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:25.258127 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-44f1b7be-0a74-4c19-80db-116cf3c098a3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1215 microversion: 2.1 time: 0.073065 Jun 20 06:54:25.258691 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1214/2495] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:25 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:26.243966 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-725bcce9-c7e2-4518-80b3-60c0b318dd3b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:26.244572 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-725bcce9-c7e2-4518-80b3-60c0b318dd3b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:26.251118 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725bcce9-c7e2-4518-80b3-60c0b318dd3b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:26.251569 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725bcce9-c7e2-4518-80b3-60c0b318dd3b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:26.253370 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725bcce9-c7e2-4518-80b3-60c0b318dd3b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:26.253833 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-725bcce9-c7e2-4518-80b3-60c0b318dd3b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:26.275639 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3d2ff4d2-1556-4dbc-aa77-afb8930cf47c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:26.276499 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3d2ff4d2-1556-4dbc-aa77-afb8930cf47c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:26.357131 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3d2ff4d2-1556-4dbc-aa77-afb8930cf47c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:26.364721 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3d2ff4d2-1556-4dbc-aa77-afb8930cf47c tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1215 microversion: 2.1 time: 0.092930 Jun 20 06:54:26.365280 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1215/2496] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:26 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:54:26.426379 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-725bcce9-c7e2-4518-80b3-60c0b318dd3b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:26.434576 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-725bcce9-c7e2-4518-80b3-60c0b318dd3b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1506 microversion: 2.1 time: 0.194199 Jun 20 06:54:26.446275 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1282/2497] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:26 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:26.452566 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cdf060fc-d72d-4e5a-afe7-98e3c1ae946d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbb72eff-92b6-497f-bc15-328805e77db7", "device": "/dev/sdb"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:26.454661 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cdf060fc-d72d-4e5a-afe7-98e3c1ae946d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:26.462670 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdf060fc-d72d-4e5a-afe7-98e3c1ae946d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:26.463124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdf060fc-d72d-4e5a-afe7-98e3c1ae946d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:26.463980 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdf060fc-d72d-4e5a-afe7-98e3c1ae946d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:26.464415 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cdf060fc-d72d-4e5a-afe7-98e3c1ae946d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:26.768092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cdf060fc-d72d-4e5a-afe7-98e3c1ae946d tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "POST /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320087 Jun 20 06:54:26.769188 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1216/2498] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jun 20 06:54:26 2022] POST /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:54:27.381685 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e0810a19-5522-4634-b38f-f4ed1279450a tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:27.382331 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e0810a19-5522-4634-b38f-f4ed1279450a tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:27.389022 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0810a19-5522-4634-b38f-f4ed1279450a tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:27.389503 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0810a19-5522-4634-b38f-f4ed1279450a tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:27.390253 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0810a19-5522-4634-b38f-f4ed1279450a tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:27.390677 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0810a19-5522-4634-b38f-f4ed1279450a tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:27.455232 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e0810a19-5522-4634-b38f-f4ed1279450a tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:27.463689 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e0810a19-5522-4634-b38f-f4ed1279450a tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1219 microversion: 2.1 time: 0.086314 Jun 20 06:54:27.465432 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1283/2499] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:27 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:28.483018 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f95665d6-c89b-464b-b296-9361234063f3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:28.484226 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f95665d6-c89b-464b-b296-9361234063f3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:28.491346 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f95665d6-c89b-464b-b296-9361234063f3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:28.492143 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f95665d6-c89b-464b-b296-9361234063f3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:28.492926 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f95665d6-c89b-464b-b296-9361234063f3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:28.493531 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f95665d6-c89b-464b-b296-9361234063f3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:28.560920 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f95665d6-c89b-464b-b296-9361234063f3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:28.570031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f95665d6-c89b-464b-b296-9361234063f3 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1273 microversion: 2.1 time: 0.091651 Jun 20 06:54:28.570807 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1217/2500] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:28 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:54:29.589090 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8ec983b0-9a6c-47f9-93f5-4f46ceca31cc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:29.589714 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8ec983b0-9a6c-47f9-93f5-4f46ceca31cc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:29.596323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ec983b0-9a6c-47f9-93f5-4f46ceca31cc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:29.596768 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ec983b0-9a6c-47f9-93f5-4f46ceca31cc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:29.597567 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ec983b0-9a6c-47f9-93f5-4f46ceca31cc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:29.598032 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ec983b0-9a6c-47f9-93f5-4f46ceca31cc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:29.813949 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-c0752dbb-8d12-4873-b2e1-8490b3d64db1 req-efbe3301-1c48-4480-83a0-96ebc76ec75b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795ebb23-cbae-4188-afa2-a506d13d7c27", "tag": "5a7bf28e-d3d5-4e01-a02b-2bb721722ce0"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:29.822816 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c0752dbb-8d12-4873-b2e1-8490b3d64db1 req-efbe3301-1c48-4480-83a0-96ebc76ec75b service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:29.823263 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-c0752dbb-8d12-4873-b2e1-8490b3d64db1 req-efbe3301-1c48-4480-83a0-96ebc76ec75b service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:29.840071 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-c0752dbb-8d12-4873-b2e1-8490b3d64db1 req-efbe3301-1c48-4480-83a0-96ebc76ec75b service nova] Creating event network-changed:5a7bf28e-d3d5-4e01-a02b-2bb721722ce0 for instance 795ebb23-cbae-4188-afa2-a506d13d7c27 on hv-cinder-80473 Jun 20 06:54:29.845747 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-c0752dbb-8d12-4873-b2e1-8490b3d64db1 req-efbe3301-1c48-4480-83a0-96ebc76ec75b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035509 Jun 20 06:54:29.846716 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1218/2501] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:54:29.976388 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8ec983b0-9a6c-47f9-93f5-4f46ceca31cc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:29.984074 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8ec983b0-9a6c-47f9-93f5-4f46ceca31cc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.398914 Jun 20 06:54:29.984652 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1284/2502] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:29 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:31.002268 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-453e339e-cf85-4e86-a8f7-7c40987399ac tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:31.003000 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-453e339e-cf85-4e86-a8f7-7c40987399ac tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:31.010279 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-453e339e-cf85-4e86-a8f7-7c40987399ac tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:31.010733 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-453e339e-cf85-4e86-a8f7-7c40987399ac tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:31.011493 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-453e339e-cf85-4e86-a8f7-7c40987399ac tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:31.011925 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-453e339e-cf85-4e86-a8f7-7c40987399ac tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:31.140274 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-453e339e-cf85-4e86-a8f7-7c40987399ac tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:31.148868 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-453e339e-cf85-4e86-a8f7-7c40987399ac tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.151324 Jun 20 06:54:31.149452 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1219/2503] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:30 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:32.165604 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-440ffb84-b56d-4114-ab05-3d18fa2135f1 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:32.166215 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-440ffb84-b56d-4114-ab05-3d18fa2135f1 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:32.172679 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-440ffb84-b56d-4114-ab05-3d18fa2135f1 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:32.173124 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-440ffb84-b56d-4114-ab05-3d18fa2135f1 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:32.173922 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-440ffb84-b56d-4114-ab05-3d18fa2135f1 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:32.174355 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-440ffb84-b56d-4114-ab05-3d18fa2135f1 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:32.301548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-440ffb84-b56d-4114-ab05-3d18fa2135f1 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:32.310097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-440ffb84-b56d-4114-ab05-3d18fa2135f1 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.148263 Jun 20 06:54:32.310602 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1285/2504] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:32 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:33.327724 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-adc61801-58bc-4f9a-bc9f-55d99530f105 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:33.328368 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-adc61801-58bc-4f9a-bc9f-55d99530f105 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:33.331016 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:33.336967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adc61801-58bc-4f9a-bc9f-55d99530f105 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:33.337474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adc61801-58bc-4f9a-bc9f-55d99530f105 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:33.338332 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adc61801-58bc-4f9a-bc9f-55d99530f105 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:33.338774 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-adc61801-58bc-4f9a-bc9f-55d99530f105 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:33.469223 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-adc61801-58bc-4f9a-bc9f-55d99530f105 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:33.477364 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-adc61801-58bc-4f9a-bc9f-55d99530f105 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.153563 Jun 20 06:54:33.477964 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1220/2505] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:33 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:34.494543 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-adccc3a3-8f9c-4eac-8d45-70cb40149f29 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:34.495864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-adccc3a3-8f9c-4eac-8d45-70cb40149f29 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:34.499709 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:34.506617 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adccc3a3-8f9c-4eac-8d45-70cb40149f29 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:34.507072 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adccc3a3-8f9c-4eac-8d45-70cb40149f29 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:34.507847 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adccc3a3-8f9c-4eac-8d45-70cb40149f29 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:34.508285 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-adccc3a3-8f9c-4eac-8d45-70cb40149f29 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:34.636738 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-adccc3a3-8f9c-4eac-8d45-70cb40149f29 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:34.644060 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-adccc3a3-8f9c-4eac-8d45-70cb40149f29 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.153614 Jun 20 06:54:34.644618 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1286/2506] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:34 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:35.660013 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d97797c8-defd-48c7-8b2a-36118855f06d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:35.660576 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d97797c8-defd-48c7-8b2a-36118855f06d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:35.667094 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d97797c8-defd-48c7-8b2a-36118855f06d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:35.667549 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d97797c8-defd-48c7-8b2a-36118855f06d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:35.668304 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d97797c8-defd-48c7-8b2a-36118855f06d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:35.668738 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d97797c8-defd-48c7-8b2a-36118855f06d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:35.799812 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d97797c8-defd-48c7-8b2a-36118855f06d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:35.807649 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d97797c8-defd-48c7-8b2a-36118855f06d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.151544 Jun 20 06:54:35.808215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1221/2507] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:35 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:36.824491 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7a5b1da3-fb09-4b4b-aec5-cd9c9f09d869 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:36.825097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7a5b1da3-fb09-4b4b-aec5-cd9c9f09d869 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:36.831822 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a5b1da3-fb09-4b4b-aec5-cd9c9f09d869 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:36.832322 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a5b1da3-fb09-4b4b-aec5-cd9c9f09d869 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:36.833953 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a5b1da3-fb09-4b4b-aec5-cd9c9f09d869 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:36.834407 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7a5b1da3-fb09-4b4b-aec5-cd9c9f09d869 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:36.969583 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7a5b1da3-fb09-4b4b-aec5-cd9c9f09d869 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:36.977130 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7a5b1da3-fb09-4b4b-aec5-cd9c9f09d869 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.156491 Jun 20 06:54:36.977716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1287/2508] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:36 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:37.587073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:54:37.587272 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:54:37.994006 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0871763d-9d5e-448b-b963-935539196f13 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:37.994651 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0871763d-9d5e-448b-b963-935539196f13 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:37.996474 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=16 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:38.002181 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0871763d-9d5e-448b-b963-935539196f13 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:38.002635 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0871763d-9d5e-448b-b963-935539196f13 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:38.003397 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0871763d-9d5e-448b-b963-935539196f13 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:38.003836 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0871763d-9d5e-448b-b963-935539196f13 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:38.137231 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0871763d-9d5e-448b-b963-935539196f13 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:38.144587 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0871763d-9d5e-448b-b963-935539196f13 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.154487 Jun 20 06:54:38.145147 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1222/2509] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:37 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:39.163955 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fb8789c4-9127-4d08-a77e-e30522125946 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:39.164792 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fb8789c4-9127-4d08-a77e-e30522125946 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:39.175207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb8789c4-9127-4d08-a77e-e30522125946 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:39.175207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb8789c4-9127-4d08-a77e-e30522125946 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:39.175207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb8789c4-9127-4d08-a77e-e30522125946 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:39.175207 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fb8789c4-9127-4d08-a77e-e30522125946 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:39.304826 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fb8789c4-9127-4d08-a77e-e30522125946 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:39.312166 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fb8789c4-9127-4d08-a77e-e30522125946 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.153743 Jun 20 06:54:39.312716 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1288/2510] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:39 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:39.782916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-7f1fa5c0-e79e-49b8-8ec2-cb078bebe1db req-bd05cdc0-4e6a-4d1b-8b6b-9edcd3d30620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795ebb23-cbae-4188-afa2-a506d13d7c27", "name": "network-vif-plugged", "status": "completed", "tag": "5a7bf28e-d3d5-4e01-a02b-2bb721722ce0"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:39.791871 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7f1fa5c0-e79e-49b8-8ec2-cb078bebe1db req-bd05cdc0-4e6a-4d1b-8b6b-9edcd3d30620 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:39.792396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7f1fa5c0-e79e-49b8-8ec2-cb078bebe1db req-bd05cdc0-4e6a-4d1b-8b6b-9edcd3d30620 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:39.804338 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-7f1fa5c0-e79e-49b8-8ec2-cb078bebe1db req-bd05cdc0-4e6a-4d1b-8b6b-9edcd3d30620 service nova] Creating event network-vif-plugged:5a7bf28e-d3d5-4e01-a02b-2bb721722ce0 for instance 795ebb23-cbae-4188-afa2-a506d13d7c27 on hv-cinder-80473 Jun 20 06:54:39.809242 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-7f1fa5c0-e79e-49b8-8ec2-cb078bebe1db req-bd05cdc0-4e6a-4d1b-8b6b-9edcd3d30620 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030048 Jun 20 06:54:39.809873 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1223/2511] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:54:40.330395 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6310a892-d6a8-4bf7-b22a-9e7c1e878a71 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:40.331011 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6310a892-d6a8-4bf7-b22a-9e7c1e878a71 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:40.339851 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6310a892-d6a8-4bf7-b22a-9e7c1e878a71 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:40.340300 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6310a892-d6a8-4bf7-b22a-9e7c1e878a71 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:40.341063 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6310a892-d6a8-4bf7-b22a-9e7c1e878a71 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:40.341527 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6310a892-d6a8-4bf7-b22a-9e7c1e878a71 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:40.474078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6310a892-d6a8-4bf7-b22a-9e7c1e878a71 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:40.481351 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6310a892-d6a8-4bf7-b22a-9e7c1e878a71 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.154938 Jun 20 06:54:40.481924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1289/2512] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:40 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:41.499718 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-828ffddd-a628-45a8-a18a-08ff9c1aaf19 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:41.500410 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-828ffddd-a628-45a8-a18a-08ff9c1aaf19 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:41.506887 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-828ffddd-a628-45a8-a18a-08ff9c1aaf19 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:41.507328 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-828ffddd-a628-45a8-a18a-08ff9c1aaf19 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:41.508076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-828ffddd-a628-45a8-a18a-08ff9c1aaf19 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:41.508509 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-828ffddd-a628-45a8-a18a-08ff9c1aaf19 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:41.634177 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-828ffddd-a628-45a8-a18a-08ff9c1aaf19 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:41.641748 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-828ffddd-a628-45a8-a18a-08ff9c1aaf19 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.146638 Jun 20 06:54:41.642302 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1224/2513] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:41 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:42.659562 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6585a274-eca7-4744-97db-2fecbf5642db tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:42.660148 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6585a274-eca7-4744-97db-2fecbf5642db tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:42.667131 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6585a274-eca7-4744-97db-2fecbf5642db tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:42.667579 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6585a274-eca7-4744-97db-2fecbf5642db tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:42.668339 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6585a274-eca7-4744-97db-2fecbf5642db tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:42.668772 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6585a274-eca7-4744-97db-2fecbf5642db tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:42.819681 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6585a274-eca7-4744-97db-2fecbf5642db tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:42.828284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6585a274-eca7-4744-97db-2fecbf5642db tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.173312 Jun 20 06:54:42.828844 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1290/2514] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:42 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:43.849777 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a50a38fb-9fbd-407a-987a-d00bd215cb98 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:43.850380 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a50a38fb-9fbd-407a-987a-d00bd215cb98 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:43.856831 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a50a38fb-9fbd-407a-987a-d00bd215cb98 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:43.857292 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a50a38fb-9fbd-407a-987a-d00bd215cb98 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:43.858073 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a50a38fb-9fbd-407a-987a-d00bd215cb98 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:43.858505 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a50a38fb-9fbd-407a-987a-d00bd215cb98 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:43.985190 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a50a38fb-9fbd-407a-987a-d00bd215cb98 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:43.992596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a50a38fb-9fbd-407a-987a-d00bd215cb98 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.147244 Jun 20 06:54:43.993153 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1225/2515] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:43 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:45.010106 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-912aa346-60ce-4ce4-aacb-26a7083120b6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:45.010744 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-912aa346-60ce-4ce4-aacb-26a7083120b6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:45.017284 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-912aa346-60ce-4ce4-aacb-26a7083120b6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:45.017764 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-912aa346-60ce-4ce4-aacb-26a7083120b6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:45.018515 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-912aa346-60ce-4ce4-aacb-26a7083120b6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:45.018950 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-912aa346-60ce-4ce4-aacb-26a7083120b6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:45.152472 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-912aa346-60ce-4ce4-aacb-26a7083120b6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:45.159918 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-912aa346-60ce-4ce4-aacb-26a7083120b6 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1315 microversion: 2.1 time: 0.153891 Jun 20 06:54:45.160469 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1291/2516] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:45 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:46.178450 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-968d38ce-8a37-4bbe-8ad1-6df7b41f891b tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:46.179076 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-968d38ce-8a37-4bbe-8ad1-6df7b41f891b tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:46.181480 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:46.187042 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-968d38ce-8a37-4bbe-8ad1-6df7b41f891b tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:46.187494 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-968d38ce-8a37-4bbe-8ad1-6df7b41f891b tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:46.188260 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-968d38ce-8a37-4bbe-8ad1-6df7b41f891b tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:46.188829 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-968d38ce-8a37-4bbe-8ad1-6df7b41f891b tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:46.193650 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:46.330472 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-968d38ce-8a37-4bbe-8ad1-6df7b41f891b tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:46.338853 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-968d38ce-8a37-4bbe-8ad1-6df7b41f891b tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1464 microversion: 2.1 time: 0.165363 Jun 20 06:54:46.339427 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1226/2517] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:46 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:46.377690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:46.378218 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:46.381903 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=43 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:46.386246 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:46.386701 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:46.387458 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:46.387910 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:46.391895 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=91 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:54:46.415068 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:54:46.471076 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [dbc8f159-34df-42c3-a347-a93ff689be44] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 06:54:47.478200 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [dbc8f159-34df-42c3-a347-a93ff689be44] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46760. Jun 20 06:54:47.497488 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-22b977f0-5463-475e-9801-7bbc1e04becc tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "DELETE /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 204 len: 0 microversion: 2.1 time: 1.123577 Jun 20 06:54:47.498081 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1292/2518] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:54:46 2022] DELETE /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:54:47.507114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f6db10fe-cb39-4243-8171-c472c2db6035 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:47.507744 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f6db10fe-cb39-4243-8171-c472c2db6035 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:47.514162 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6db10fe-cb39-4243-8171-c472c2db6035 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:47.514610 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6db10fe-cb39-4243-8171-c472c2db6035 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:47.515365 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6db10fe-cb39-4243-8171-c472c2db6035 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:47.515801 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f6db10fe-cb39-4243-8171-c472c2db6035 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:47.648145 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f6db10fe-cb39-4243-8171-c472c2db6035 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:47.655596 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f6db10fe-cb39-4243-8171-c472c2db6035 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1470 microversion: 2.1 time: 0.152693 Jun 20 06:54:47.656161 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1227/2519] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:47 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:54:48.136348 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e0e004dc-3bfc-45a7-8c75-3a4549fabc76 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:48.136929 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e0e004dc-3bfc-45a7-8c75-3a4549fabc76 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:48.142881 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0e004dc-3bfc-45a7-8c75-3a4549fabc76 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:48.143320 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0e004dc-3bfc-45a7-8c75-3a4549fabc76 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:48.144065 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0e004dc-3bfc-45a7-8c75-3a4549fabc76 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:48.144489 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0e004dc-3bfc-45a7-8c75-3a4549fabc76 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:48.226037 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-e0e004dc-3bfc-45a7-8c75-3a4549fabc76 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lazy-loading 'services' on Instance uuid 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:54:48.295595 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e0e004dc-3bfc-45a7-8c75-3a4549fabc76 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "DELETE /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209/os-volume_attachments/cbb72eff-92b6-497f-bc15-328805e77db7" status: 202 len: 0 microversion: 2.1 time: 0.164094 Jun 20 06:54:48.296169 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1293/2520] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jun 20 06:54:48 2022] DELETE /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209/os-volume_attachments/cbb72eff-92b6-497f-bc15-328805e77db7 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:54:48.673215 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0513a52a-51ac-4923-8b33-3edc45ca5cfb tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:48.673867 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0513a52a-51ac-4923-8b33-3edc45ca5cfb tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:48.681256 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0513a52a-51ac-4923-8b33-3edc45ca5cfb tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:48.681740 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0513a52a-51ac-4923-8b33-3edc45ca5cfb tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:48.682614 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0513a52a-51ac-4923-8b33-3edc45ca5cfb tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:48.683051 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0513a52a-51ac-4923-8b33-3edc45ca5cfb tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:48.836743 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0513a52a-51ac-4923-8b33-3edc45ca5cfb tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:48.844171 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0513a52a-51ac-4923-8b33-3edc45ca5cfb tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1470 microversion: 2.1 time: 0.175411 Jun 20 06:54:48.844739 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1228/2521] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:48 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:49.862323 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57d3dd85-b68c-44eb-840a-5efb55dd230d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:49.863015 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-57d3dd85-b68c-44eb-840a-5efb55dd230d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:49.870264 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57d3dd85-b68c-44eb-840a-5efb55dd230d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:49.870704 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57d3dd85-b68c-44eb-840a-5efb55dd230d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:49.871464 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57d3dd85-b68c-44eb-840a-5efb55dd230d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:49.871894 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57d3dd85-b68c-44eb-840a-5efb55dd230d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:50.123765 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-57d3dd85-b68c-44eb-840a-5efb55dd230d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:50.132773 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-57d3dd85-b68c-44eb-840a-5efb55dd230d tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1470 microversion: 2.1 time: 0.274605 Jun 20 06:54:50.142650 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1294/2522] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:49 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:50.232736 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-10ff17bf-6144-46a8-8163-4046016a990b req-73b8e8b5-242a-4144-b57f-4fa6bdeccfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795ebb23-cbae-4188-afa2-a506d13d7c27", "name": "network-vif-deleted", "tag": "5a7bf28e-d3d5-4e01-a02b-2bb721722ce0"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:50.243396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-10ff17bf-6144-46a8-8163-4046016a990b req-73b8e8b5-242a-4144-b57f-4fa6bdeccfc5 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:50.244124 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-10ff17bf-6144-46a8-8163-4046016a990b req-73b8e8b5-242a-4144-b57f-4fa6bdeccfc5 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:50.259616 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-10ff17bf-6144-46a8-8163-4046016a990b req-73b8e8b5-242a-4144-b57f-4fa6bdeccfc5 service nova] Creating event network-vif-deleted:5a7bf28e-d3d5-4e01-a02b-2bb721722ce0 for instance 795ebb23-cbae-4188-afa2-a506d13d7c27 on hv-cinder-80473 Jun 20 06:54:50.265048 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-10ff17bf-6144-46a8-8163-4046016a990b req-73b8e8b5-242a-4144-b57f-4fa6bdeccfc5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102411 Jun 20 06:54:50.265699 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1229/2523] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:54:50.464553 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-47b13ce6-28fa-4b9b-962c-4f614741fb0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:50.465053 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-47b13ce6-28fa-4b9b-962c-4f614741fb0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:50.471003 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47b13ce6-28fa-4b9b-962c-4f614741fb0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:50.471456 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47b13ce6-28fa-4b9b-962c-4f614741fb0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:50.472213 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47b13ce6-28fa-4b9b-962c-4f614741fb0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:50.472649 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47b13ce6-28fa-4b9b-962c-4f614741fb0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:50.498964 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-47b13ce6-28fa-4b9b-962c-4f614741fb0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:54:50.571162 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-47b13ce6-28fa-4b9b-962c-4f614741fb0b tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "DELETE /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 204 len: 0 microversion: 2.1 time: 0.110137 Jun 20 06:54:50.571723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1295/2524] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jun 20 06:54:50 2022] DELETE /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:54:50.580880 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eb9dacfa-ac89-43cb-911b-caaeed67bde8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:50.581448 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eb9dacfa-ac89-43cb-911b-caaeed67bde8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:50.588653 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb9dacfa-ac89-43cb-911b-caaeed67bde8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:50.589097 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb9dacfa-ac89-43cb-911b-caaeed67bde8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:50.589944 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb9dacfa-ac89-43cb-911b-caaeed67bde8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:50.590369 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb9dacfa-ac89-43cb-911b-caaeed67bde8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:50.724967 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eb9dacfa-ac89-43cb-911b-caaeed67bde8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:50.732466 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eb9dacfa-ac89-43cb-911b-caaeed67bde8 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1512 microversion: 2.1 time: 0.156165 Jun 20 06:54:50.733031 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1230/2525] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:50 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:54:51.151808 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:51.152513 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:51.158879 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:51.159327 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:51.160078 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:51.160511 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:51.191924 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:51.193403 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:51.193864 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lazy-loading 'fault' on Instance uuid 795ebb23-cbae-4188-afa2-a506d13d7c27 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:54:51.233683 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269859b4844d4e8bb44315064eb4af77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51931e260aae426b93a7868048b03f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:51.242146 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c3cc7e51-5ca4-4357-b656-3bac7897cad2 tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 200 len: 1305 microversion: 2.1 time: 0.094468 Jun 20 06:54:51.242718 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1296/2526] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:51 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:51.750331 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-34e5a93d-7e9b-4fa1-b7f8-1921ef05a8fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:51.751017 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-34e5a93d-7e9b-4fa1-b7f8-1921ef05a8fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:51.757640 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34e5a93d-7e9b-4fa1-b7f8-1921ef05a8fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:51.758095 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34e5a93d-7e9b-4fa1-b7f8-1921ef05a8fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:51.758860 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34e5a93d-7e9b-4fa1-b7f8-1921ef05a8fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:51.759301 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-34e5a93d-7e9b-4fa1-b7f8-1921ef05a8fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:51.887092 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-34e5a93d-7e9b-4fa1-b7f8-1921ef05a8fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:51.894396 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-34e5a93d-7e9b-4fa1-b7f8-1921ef05a8fb tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1512 microversion: 2.1 time: 0.147916 Jun 20 06:54:51.894957 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1231/2527] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:51 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:52.258691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:52.259243 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] [instance: 795ebb23-cbae-4188-afa2-a506d13d7c27] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:52.266073 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:52.266516 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:52.267261 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:52.267690 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:52.281125 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] HTTP exception thrown: Instance 795ebb23-cbae-4188-afa2-a506d13d7c27 could not be found. Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Request method failure captured: Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 HTTP/1.1 Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Connection: close Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Host: 10.222.0.16 Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABisBmcrzZZ_suh7K2nQgjbRAMFfv9WPQR4xuu8lFsV-wumx_4s_yssy_yz-I3C52fjcXTt-o40SxJd67nv4PuEPKUrbu60Hn8D36hyeZ_foTmYDM2D-HJT_6A3KJFe_k3T0xSjlwZ6zIJqSr8xkTooeCZhhszktyZi6vaM3PmGpAbbqE8 Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Id: 51931e260aae426b93a7868048b03f55 Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesNegativeTest-965439700 Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Role: reader,member Jun 20 06:54:52.282762 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Roles: reader,member Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51931e260aae426b93a7868048b03f55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_51931e260aae426b93a7868048b03f55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/51931e260aae426b93a7868048b03f55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51931e260aae426b93a7868048b03f55"}]}] Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesNegativeTest-965439700 Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 51931e260aae426b93a7868048b03f55 Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesNegativeTest-965439700 Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesNegativeTest-965439700-project Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Id: 269859b4844d4e8bb44315064eb4af77 Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesNegativeTest-965439700-project Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: method: > Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: exception: Instance 795ebb23-cbae-4188-afa2-a506d13d7c27 could not be found. Jun 20 06:54:52.284624 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: action_args: {'id': '795ebb23-cbae-4188-afa2-a506d13d7c27'} Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795ebb23-cbae-4188-afa2-a506d13d7c27 could not be found. Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:54:52.285889 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795ebb23-cbae-4188-afa2-a506d13d7c27 could not be found. Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795ebb23-cbae-4188-afa2-a506d13d7c27 could not be found. Jun 20 06:54:52.288266 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 20 06:54:52.289816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] Returning 404 to user: Instance 795ebb23-cbae-4188-afa2-a506d13d7c27 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:54:52.289816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3f6134b4-a00d-4e4b-bdd6-013f2022eeee tempest-VolumesNegativeTest-965439700 tempest-VolumesNegativeTest-965439700-project] 10.222.0.16 "GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27" status: 404 len: 111 microversion: 2.1 time: 0.029468 Jun 20 06:54:52.289816 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1297/2528] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:52 2022] GET /compute/v2.1/servers/795ebb23-cbae-4188-afa2-a506d13d7c27 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:54:52.914630 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7126487a-264a-441b-b335-9a3cb6f0a8ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:52.915469 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7126487a-264a-441b-b335-9a3cb6f0a8ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:52.922874 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7126487a-264a-441b-b335-9a3cb6f0a8ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:52.923336 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7126487a-264a-441b-b335-9a3cb6f0a8ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:52.924114 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7126487a-264a-441b-b335-9a3cb6f0a8ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:52.924559 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7126487a-264a-441b-b335-9a3cb6f0a8ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:53.152820 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7126487a-264a-441b-b335-9a3cb6f0a8ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a38dccab9404882be501aeb64a228f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4cdcfeeefd4d598f28a1316087944f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:54:53.160878 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7126487a-264a-441b-b335-9a3cb6f0a8ac tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 200 len: 1512 microversion: 2.1 time: 0.251034 Jun 20 06:54:53.161923 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1232/2529] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:52 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:54:53.442097 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-062ab821-72d1-4155-a173-d6cd8763178a req-96255938-8d66-4a53-a5fc-b0b33c437fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187af4c6-b9e1-4bd3-8541-ea34e4e3b209", "name": "network-vif-deleted", "tag": "692b38e4-e689-4aa1-a530-33c12e060a4c"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:54:53.454324 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-062ab821-72d1-4155-a173-d6cd8763178a req-96255938-8d66-4a53-a5fc-b0b33c437fa0 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:53.454818 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-062ab821-72d1-4155-a173-d6cd8763178a req-96255938-8d66-4a53-a5fc-b0b33c437fa0 service nova] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:53.472691 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-062ab821-72d1-4155-a173-d6cd8763178a req-96255938-8d66-4a53-a5fc-b0b33c437fa0 service nova] Creating event network-vif-deleted:692b38e4-e689-4aa1-a530-33c12e060a4c for instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 on hv-cinder-80473 Jun 20 06:54:53.479743 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-062ab821-72d1-4155-a173-d6cd8763178a req-96255938-8d66-4a53-a5fc-b0b33c437fa0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041004 Jun 20 06:54:53.480645 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1298/2530] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jun 20 06:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:54:54.186498 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:54:54.187119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] [instance: 187af4c6-b9e1-4bd3-8541-ea34e4e3b209] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:54:54.198457 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:54.198916 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:54.199845 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:54:54.200297 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Lock "43279633-07ee-4e93-b9f3-9c7baabf2ceb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:54:54.215022 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] HTTP exception thrown: Instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 could not be found. Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Request method failure captured: Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 HTTP/1.1 Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Connection: close Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Host: 10.222.0.16 Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABisBIDD20nzfr83Fhd2pEJY55NslqymEvc39YW0Kr4x0EA2Cz6oFmHb7GSlgL6v5lumsIsygAQ_fOJqS1coIYVq72s8FgvM3EVO3JXP-H2b3G5MHH4_O6SUiQ99XtMkorz1RTBXeb940rRDrTQu9hjTcaodxH5fJkepnaFdcDjjFp9dRA Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Role: reader,member Jun 20 06:54:54.216696 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Roles: reader,member Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef4cdcfeeefd4d598f28a1316087944f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef4cdcfeeefd4d598f28a1316087944f"}]}] Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Id: ef4cdcfeeefd4d598f28a1316087944f Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-546354105 Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Id: 0a38dccab9404882be501aeb64a228f6 Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesSnapshotTestJSON-546354105-project Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: method: > Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: exception: Instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 could not be found. Jun 20 06:54:54.218367 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: action_args: {'id': '187af4c6-b9e1-4bd3-8541-ea34e4e3b209'} Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 could not be found. Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:54:54.219597 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 could not be found. Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 could not be found. Jun 20 06:54:54.221119 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 20 06:54:54.222428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] Returning 404 to user: Instance 187af4c6-b9e1-4bd3-8541-ea34e4e3b209 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:54:54.222428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f0b7b964-d357-4db4-8722-65b6c95de039 tempest-VolumesSnapshotTestJSON-546354105 tempest-VolumesSnapshotTestJSON-546354105-project] 10.222.0.16 "GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209" status: 404 len: 111 microversion: 2.1 time: 0.035486 Jun 20 06:54:54.222428 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1233/2531] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jun 20 06:54:54 2022] GET /compute/v2.1/servers/187af4c6-b9e1-4bd3-8541-ea34e4e3b209 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:55:01.797020 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d983f3c3-431f-46aa-84ad-346eacc734ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] Calling method '.version_select at 0x7f7a7a5fbd30>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:55:01.835548 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d983f3c3-431f-46aa-84ad-346eacc734ad tempest-TestVolumeBootPattern-728897810 tempest-TestVolumeBootPattern-728897810-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-447985312" status: 202 len: 0 microversion: 2.1 time: 0.042495 Jun 20 06:55:01.836254 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1299/2532] 10.222.0.16 () {58 vars in 1259 bytes} [Mon Jun 20 06:55:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-447985312 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:55:19.533496 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ef0b1d6e-15a6-44ad-9fad-24299d862ab8 tempest-TestMinimumBasicScenario-507774080 tempest-TestMinimumBasicScenario-507774080-project] Action: 'create', calling method: .version_select at 0x7f7a7a784790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2042812509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlXT8gkoKN72/wXyMSMwja5M2798SHqb05Do6HyyMiZVodnRpmjBqPhVKXScEpXne88rNty3kr3gWow/FsS+l3WmmikCZ1H3x8+4PYHUg6kabgI46/nEpKuk/tU7+BNg=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:55:19.538679 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=15 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:19.539335 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=39 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:55:19.550655 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-ef0b1d6e-15a6-44ad-9fad-24299d862ab8 tempest-TestMinimumBasicScenario-507774080 tempest-TestMinimumBasicScenario-507774080-project] Getting quotas for project 2aac1f56c3944004b44f10b5cb8c078f. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:55:19.555618 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-ef0b1d6e-15a6-44ad-9fad-24299d862ab8 tempest-TestMinimumBasicScenario-507774080 tempest-TestMinimumBasicScenario-507774080-project] Getting quotas for user 9ae5657265bc4f3aa8a6a7dfe6a257dc and project 2aac1f56c3944004b44f10b5cb8c078f. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:57:57.595767 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:57:57.596312 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:57:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:58:00.144954 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:58:00.145607 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:58:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:59:39.827948 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:59:39.828518 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 06:59:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Jun 20 06:59:58.365247 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:59:58.365723 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 06:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:00:00.573349 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:00:00.573922 dv-cinder-804735-31-iscsi devstack@n-api.service[117727]: Mon Jun 20 07:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Jun 20 07:01:17.603563 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:01:17.604248 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 07:01:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:01:20.154244 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:01:20.154882 dv-cinder-804735-31-iscsi devstack@n-api.service[117726]: Mon Jun 20 07:01:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!